-- Logs begin at Wed 2021-12-15 15:38:44 UTC, end at Wed 2021-12-15 17:06:12 UTC. -- Dec 15 16:06:53.129550 dv-cinder-820027-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 16:06:53.138648 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 16:06:53.141609 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:06:53 2021] *** Dec 15 16:06:53.141770 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: nodename: dv-cinder-820027-2-iscsi Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: machine: x86_64 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: clock source: unix Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: pcre jit disabled Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: detected number of CPU cores: 4 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: current working directory: / Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: your processes number limit is 47680 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: your memory page size is 4096 bytes Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: detected max file descriptor number: 2048 Dec 15 16:06:53.141897 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: lock engine: pthread robust mutexes Dec 15 16:06:53.142829 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: thunder lock: enabled Dec 15 16:06:53.142829 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 16:06:53.142829 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:06:53.186192 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: Python main interpreter initialized at 0x55f2bc2309c0 Dec 15 16:06:53.186192 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: python threads support enabled Dec 15 16:06:53.186192 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: your server socket listen backlog is limited to 100 connections Dec 15 16:06:53.186192 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:06:53.186596 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:06:53.186675 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: *** Operational MODE: preforking *** Dec 15 16:06:53.186939 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:06:53.186939 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: spawned uWSGI master process (pid: 79183) Dec 15 16:06:53.187205 dv-cinder-820027-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 16:06:53.187752 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: spawned uWSGI worker 1 (pid: 79197, cores: 1) Dec 15 16:06:53.188334 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: spawned uWSGI worker 2 (pid: 79198, cores: 1) Dec 15 16:06:53.188334 dv-cinder-820027-2-iscsi devstack@keystone.service[79183]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:06:58.514957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:58.514957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: from cryptography.utils import int_from_bytes Dec 15 16:06:58.515783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:58.515783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: from cryptography.utils import int_from_bytes Dec 15 16:06:58.516322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:58.516322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: from cryptography.utils import int_from_bytes Dec 15 16:06:58.516814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:58.516814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: from cryptography.utils import int_from_bytes Dec 15 16:06:58.564811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:06:58.565015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:06:58.565179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] command line args: [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:06:58.565457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:06:58.565592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ================================================================================ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:06:58.565848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] admin_token = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.566099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_dir = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.566267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.566485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_source = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.566616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] debug = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.566840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.567092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:06:58.567172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.567241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:06:58.567377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.567469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] command line args: [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:06:58.567585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.567668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:06:58.567858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ================================================================================ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:06:58.567982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] admin_token = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_config_append = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_dir = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_dir = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_source = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.568956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] debug = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.569906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_config_append = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_dir = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.570966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.571928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.572885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] publish_errors = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.573904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] standard_threads = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.574879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] publish_errors = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_journal = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_json = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_stderr = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_syslog = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.575945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.576060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.576180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.576300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.576420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.576557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.576681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] standard_threads = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.576797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.576918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.577032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.577152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.577267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.577379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.577379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_journal = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.577675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.577792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_json = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.577911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.578030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_stderr = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.578030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_syslog = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.578258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.578390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:58.578521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.578661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.578786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.578901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.579940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.580914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.581919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.582982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.583998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.584995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.585966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.586901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.587937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.588963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.589934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.590900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.591971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.592955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.593931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.594990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.595896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.596970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.597936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.598984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.external = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.599927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.password = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.token = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.600942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.601992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.external = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.602930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.password = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.token = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.603908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.604967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.605964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606397 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.606974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.607871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.608986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.609907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.610980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.611962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.612929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.613995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.614948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.615872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.616917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.617941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.618978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.619904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.620904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.621957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.622896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.623953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.624919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.625950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.626965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.627886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.628842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.629948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.630947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.631995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.632971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.633899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.634947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.635888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.636991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.637927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.638954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.639890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.640952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.641821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.642949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.643790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.644027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.644263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.644522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.644762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.645035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.645273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.645519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.645754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.646002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.646237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.646480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.646708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.646948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.647185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.647384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.647543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:06:58.651055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.651372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.651655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.651921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.652190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.652476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.652748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.653001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.653251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.653495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.653752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.654011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.654250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.654501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.654777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.655046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.655296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.655551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.655794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.656040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.656283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.656962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.657232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.657522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.657806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.658052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.658305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.658545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.658797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.659039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.659290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.659524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.659767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.660005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:58.660178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:06:58.677657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.677885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.678113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.685649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.685884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.686114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.686913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.695534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.717788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.717995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.725482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.725720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.772380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.773617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.822361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.822578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.824395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.824659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.891933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.892979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.893045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.893119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.893333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.893510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.893705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.916661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.916861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.916945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.917867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.918004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.918071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.918214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.918294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.929751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.930137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.943894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.944683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 16:06:58.961935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.962210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.962364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 16:06:58.962503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 16:06:58.962631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.962781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.962908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 16:06:58.963037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 16:06:58.963168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.963967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.964097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.974617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.974909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.975168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.975290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.975493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.975621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.975845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.976074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.983623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:58.984205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:58.986938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:58.987216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.987496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.987773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.987902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:58.988028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.988975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.989955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.990237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:58.990497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.015798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.017113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.017550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.017839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.018714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.018993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.023075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.024124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.025130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.025441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.026280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.026570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.032709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.032990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.034156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.034436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.037355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.037639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.037919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.038204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.038511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.038789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.038983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.039119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.039244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.039367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.039492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.039638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.039877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.040154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.040414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.040711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.057835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.058115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.059449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.059728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.062516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.064650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.066305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.066709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.068223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.068674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.071571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.073598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.075063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.077117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.078851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.079155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.079428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.079700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.079980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.080263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.081172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.081467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.081744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.082020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.082304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.082604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.101181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.101428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.101725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.101986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.102792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.103082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.103346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.103605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.109708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.111418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.111695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.111846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.113398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.113671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.114830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.115108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.115389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.115678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.115956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.116794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.117177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.117440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.117661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.117872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.129007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.129290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.129572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.129843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.130225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.130497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.130775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.137460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.137745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.138025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.138302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.138678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.138950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.139238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.148700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.151880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.155115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.156956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.157784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.158556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.158839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.159116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.161042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.164280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.166036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.166231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.167645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.167793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.167933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.168199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.170909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.171214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.171607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.171890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.175451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.177068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.180215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.180533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.180932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.181075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.181202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.181326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.181524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.189315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.189594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.189868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.190122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.190251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.190388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.190527 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.190725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.190852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.191039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.191299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.191582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.191850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.192115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.192390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.192692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.192949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.198447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 16:06:59.198837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.199035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.199319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.199590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.199970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.200234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.200554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.200828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.201108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.201387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.201652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.201933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.202199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 16:06:59.230278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2bc2309c0 pid: 79197 (default app) Dec 15 16:06:59.233812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b17ff-2f9a-4bc4-844a-9e7403669a65 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:06:59.234099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b17ff-2f9a-4bc4-844a-9e7403669a65 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:06:59.234377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b17ff-2f9a-4bc4-844a-9e7403669a65 None None] PATH_INFO: `/v3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:06:59.238885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Dec 15 16:06:59 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:06:59.239595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2bc2309c0 pid: 79198 (default app) Dec 15 16:07:07.289436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:07.289975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:07.289975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:07.292063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:07.300823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:07.301279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:07.301362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:07.333978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG oslo_db.sqlalchemy.engines [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:07:07.534213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG passlib.handlers.bcrypt [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 16:07:07.534560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG passlib.handlers.bcrypt [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 16:07:07.590613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:07.592631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:07.727593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:07.775205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:07.816068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG oslo_db.sqlalchemy.engines [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:07:07.952522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951cff-f187-4bfa-af8f-87d3e96e8640 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:07.958134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:07.958790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:07.959040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:07.959327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:07.968740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:08.021410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 16:07:08.021765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d1326-98c6-40f8-9c90-cb56b66ab951 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:08.032847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:08.039688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:08.055416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4096b-c945-4731-9d52-b01cc95c7c56 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:08.060417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:08.061574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:08.061854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:08.062095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] PATH_INFO: `/v3/projects/8a6b08d818d54c3e97808ca092a07d94` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:08.066575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a6b08d818d54c3e97808ca092a07d94)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:08.117087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 16:07:08.117426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dc31a-9403-45a3-91d3-5eb309e74731 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:08.122166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 2/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:08 2021] GET /identity/v3/projects/8a6b08d818d54c3e97808ca092a07d94 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:10.504310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ba2c-4931-4726-b687-a0a8be66048d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.504874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ba2c-4931-4726-b687-a0a8be66048d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.504874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ba2c-4931-4726-b687-a0a8be66048d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.509358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 4/6] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:10.516159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.516703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.517095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.538359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:10.539906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:10.549508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:10.573302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ba2c-4931-4726-b687-a0a8be66048d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:10.586371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ba2c-4931-4726-b687-a0a8be66048d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:10.591496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:10.592139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.592416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.592719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.601471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:10.603259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4d9b-030b-4dd4-8b55-b07c252fccea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:10.612204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:10.619013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:10.628851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a325-7dfa-4bfc-8e4d-c72e73279da2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:10.633721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:10.634599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.634914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.635123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.636684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:10.638529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809276e-5ef0-4b39-9cb4-f00a81390e2f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:10.640127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 4/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:10 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:13.228319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca353-7f9a-4617-b0a1-cc45e827b27b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.228896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca353-7f9a-4617-b0a1-cc45e827b27b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.228896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca353-7f9a-4617-b0a1-cc45e827b27b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.230635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:13.237224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbccd25-ffbc-4152-9921-a592c5e94dd6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.237690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbccd25-ffbc-4152-9921-a592c5e94dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.237771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbccd25-ffbc-4152-9921-a592c5e94dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.257172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-adbccd25-ffbc-4152-9921-a592c5e94dd6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:13.258388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-adbccd25-ffbc-4152-9921-a592c5e94dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:13.267280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:13.290801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca353-7f9a-4617-b0a1-cc45e827b27b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.306647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca353-7f9a-4617-b0a1-cc45e827b27b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.310456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082aa5b-c847-4359-bec0-09e1e93dd688 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.310714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082aa5b-c847-4359-bec0-09e1e93dd688 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.310992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082aa5b-c847-4359-bec0-09e1e93dd688 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.313926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 6/12] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:13.316882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.317794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.318302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.318720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.320320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.320681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.320968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.328801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.330627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.340289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:13.340640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:13.342127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:13.347426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.350581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:13.356585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606c04-d8df-4fe3-be8d-5fc222a7fd7e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.361906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.362684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.362964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.363231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.364745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.366447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.368272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:13.375748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.385446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e4ed-e76e-4027-8056-c9db02e7656f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.390429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.391401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.391725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.391993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.408968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:13.416103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:13.417452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:13.424858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.442857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd605c-97e0-48b8-b89e-47dadd8b2af2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.451811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.453193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.453827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.454314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.455899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:13.456479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.460073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:13.460073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:13.460073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:13.461969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.487758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:13.495694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.506755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857f0-78c7-4f32-bb73-ca7375e92341 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.512065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.513030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.513311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.513583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.515039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.517338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.519143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:13.527095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.540477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72070-c2a0-4765-bcc1-52197dc53fb9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.545763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.546616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.546906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.547721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.549292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.551135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adab9f-4bb7-4d7d-b098-578d612d0cf6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.552971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:13.559776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:13.571038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba22d6-e82e-4ddf-9abb-dc28427e88ab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:13.576327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:13.577078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:13.577361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:13.577626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:13.579239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.domain.id=default, user.id=22207ac88e304d2bb4d51c7880d43bd3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:13.579591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:13.581573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:13.581573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:13.581573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:13.582778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb51e-5001-432b-a70d-2aa5bf806b84 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:13.591446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1343 bytes} [Wed Dec 15 16:07:13 2021] GET /identity/v3/role_assignments?user.id=22207ac88e304d2bb4d51c7880d43bd3&scope.domain.id=default&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:16.451494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ac09d-d5cc-4d26-98e2-3dd19757eb89 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:16.452272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ac09d-d5cc-4d26-98e2-3dd19757eb89 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:16.452272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ac09d-d5cc-4d26-98e2-3dd19757eb89 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:16.454136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:16.460616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b880-bc67-4606-b2c0-b390bfe12172 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:16.461153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b880-bc67-4606-b2c0-b390bfe12172 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:16.461153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b880-bc67-4606-b2c0-b390bfe12172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:16.616702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5177b880-bc67-4606-b2c0-b390bfe12172 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:16.617937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5177b880-bc67-4606-b2c0-b390bfe12172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:16.631273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:16.668753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ac09d-d5cc-4d26-98e2-3dd19757eb89 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:16.681716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ac09d-d5cc-4d26-98e2-3dd19757eb89 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:16.692368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:16.693096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:16.693462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:16.693741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:16.694620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:16.695695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:16.695695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:16.695695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:16.696659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352bf1-e26f-44e7-8ff8-0e4b5910683d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:16.849360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 12/23] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:07:16 2021] POST /identity/v3/roles => generated 219 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:17.381096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d17-b6cb-474d-a9fe-45df0f19ec67 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.381322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d17-b6cb-474d-a9fe-45df0f19ec67 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.381684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d17-b6cb-474d-a9fe-45df0f19ec67 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.383717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:17.392052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.392556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.393052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.572106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG passlib.handlers.bcrypt [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79197) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 16:07:17.573285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG passlib.handlers.bcrypt [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79197) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 16:07:17.628234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:17.630014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:17.659538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:17.684743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497d17-b6cb-474d-a9fe-45df0f19ec67 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:17.701575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497d17-b6cb-474d-a9fe-45df0f19ec67 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:17.706768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:17.707972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.708490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.708954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.727943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:17.735890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:17.740898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 13/26] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:17.747763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:17.760130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1edbb-0a11-4d55-b4af-30d5c74ae789 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:17.765146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:17.766879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.767423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.767874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.769075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:17.769595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:17.771697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:17.787776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 14/27] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:17.794605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:17.809515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a57bb-9489-4461-b1a2-b17904b20803 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:17.815187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:17.816416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.816911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.817360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.818920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:17.821131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:17.823666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 14/28] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:17 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:17.829474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:17.841958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be495d-53d6-48d3-95a5-98191471e73f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:17.847054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:17.854008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.854649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.855106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.857074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:17.859275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b4fbc-4e81-443a-962d-57fad510b5ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:17.861553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 15/29] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:17.868420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:17.881271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41c14-7916-47b2-a99c-e21d3f5c909d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:17.886540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:17.887835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.888343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.888897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] PATH_INFO: `/v3/domains/default/users/22207ac88e304d2bb4d51c7880d43bd3/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.891540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=22207ac88e304d2bb4d51c7880d43bd3, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:17.892981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:17.892981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:17.892981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:17.895556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67e7f-de1a-48aa-b896-d6ec81ea128a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:17.939495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03b2d-f3c9-41b9-9371-f1c4e543d49d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.939996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03b2d-f3c9-41b9-9371-f1c4e543d49d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.940415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03b2d-f3c9-41b9-9371-f1c4e543d49d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.944834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:17.951268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:17.951805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:17.952226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:17.988110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:17.997296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:18.037472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1382 bytes} [Wed Dec 15 16:07:17 2021] PUT /identity/v3/domains/default/users/22207ac88e304d2bb4d51c7880d43bd3/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:18.086846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501258ef-defa-4afe-877b-5b9d83dfccdc None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.087390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501258ef-defa-4afe-877b-5b9d83dfccdc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.087821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501258ef-defa-4afe-877b-5b9d83dfccdc None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.093592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 16/32] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:18 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:18.102528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.102816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.103103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.137662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:18.142624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:18.184304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:18.226892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:18.240572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb1686-d7be-4695-b23a-f244b682ea55 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:18.257338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:18.259066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 17/34] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:18.260252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.260731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.261160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.286109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:18.287451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:18.288133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:18.298822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee837c5-610a-4b7f-835c-f20ffba6232e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:18.310659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:18.311393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.311684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.311973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.313375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:18.314847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:18.314847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:18.314847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:18.315807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:18.316681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:07:18.318469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 18/35] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:18.326795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:18.341660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb515f-1f5b-4498-b73b-c425ae352cdb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:18.347983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:18.348807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.349145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.349429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.350231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:07:18 2021] POST /identity/v3/roles => generated 223 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:18.358448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:18.358770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:18.360100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:18.360100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:18.360100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:18.361355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d071d9-3f0d-4e49-9088-bacb4469a0de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:18.401857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 19/37] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:07:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:18.410420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:18.447616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbffae-5775-498b-876a-a178e454dda1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:18.457123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:18.457878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.458169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.458451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.459273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:18.460393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:18.460393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:18.460393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:18.461724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:18.511948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2360-9917-4888-ac41-36103f25b27b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.511948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2360-9917-4888-ac41-36103f25b27b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.511948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2360-9917-4888-ac41-36103f25b27b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.515850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 20/38] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:18.517013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:07:18 2021] POST /identity/v3/projects => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:18.521611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365220-a37f-4700-8830-a6dce42e2c7e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.522028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365220-a37f-4700-8830-a6dce42e2c7e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.522253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365220-a37f-4700-8830-a6dce42e2c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.544286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-52365220-a37f-4700-8830-a6dce42e2c7e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:18.545825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-52365220-a37f-4700-8830-a6dce42e2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:18.637118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:18.684070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:18.710038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63af8-bb4f-4da7-85ec-2fc50ca0914a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:18.723284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:18.725173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:18.726087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:18.727053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:18.729105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:18.733111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9215-dd7d-4dd2-b5da-d489dfb78918 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:18.769984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:07:18 2021] POST /identity/v3/roles => generated 225 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:19.093556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d30e-5dc3-4768-9591-0ede531a1d83 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:19.094189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d30e-5dc3-4768-9591-0ede531a1d83 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:19.094711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d30e-5dc3-4768-9591-0ede531a1d83 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:19.098365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 22/42] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:19 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:19.105997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:19.106504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:19.106989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:19.133766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:19.135007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:19.143739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:19.169274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d30e-5dc3-4768-9591-0ede531a1d83 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:19.182106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d30e-5dc3-4768-9591-0ede531a1d83 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:19.186399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:19.187211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:19.187524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:19.187812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:19.189086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:19.190845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c9c91-ccb1-44b1-9847-402b02287735 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:19.192608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 23/44] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:19.198732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:19.208839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757378-f696-436d-9df3-bc02d4ddb98a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:19.213818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:19.214497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:19.214786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:19.215062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:19.215805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:19.218207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68f33-ddf2-459c-b2fc-dd6f4db8eb04 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:19.246171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:07:19 2021] POST /identity/v3/projects => generated 312 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:20.754037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33dcc-2b6c-4ccf-8b6d-5655ef52bbd6 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:20.754579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33dcc-2b6c-4ccf-8b6d-5655ef52bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:20.754667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33dcc-2b6c-4ccf-8b6d-5655ef52bbd6 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:20.756630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 24/46] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:20.762787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:20.763280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:20.763361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:20.781955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:20.783300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:20.844409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 23/47] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:20.868969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d33dcc-2b6c-4ccf-8b6d-5655ef52bbd6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:20.882829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d33dcc-2b6c-4ccf-8b6d-5655ef52bbd6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:20.887932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:20.888867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:20.889147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:20.889415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:20.902163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:20.909152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:20.910353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:20.916743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:20.926377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a7461-df8c-46ff-bfe3-14bf4af6497e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:20.931825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:20.932541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:20.932829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:20.933109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:20.933884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:20.934194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:20.935220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:20.935220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:20.935220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:20.936138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:20.950145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 24/49] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:20.956711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:20.968008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486aab-a180-4aa1-8266-33b566780a56 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:20.973592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:20.974476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:20.974761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:20.975035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:20.976567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:20.978432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:20.980247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:20 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:20.986429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:20.997148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c834c1e-8016-4df5-a088-c868b4b3b4b7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:21.002609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:21.003463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.003717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.004017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.005470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:21.007140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a7a68-3066-48a5-8699-ff5128ee1cf9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:21.008781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 25/51] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:21.015246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:21.025441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8fb4b-99a0-4486-a9b1-4a92a5845040 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:21.030335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:21.030992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.031343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.031651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.032533 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.domain.id=default, user.id=22207ac88e304d2bb4d51c7880d43bd3) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:21.032855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:21.033878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:21.033878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:21.033878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:21.035060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ee30-6146-4a58-8a22-587fe411ea10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:21.042898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 27/52] 10.222.0.30 () {56 vars in 1343 bytes} [Wed Dec 15 16:07:21 2021] GET /identity/v3/role_assignments?user.id=22207ac88e304d2bb4d51c7880d43bd3&scope.domain.id=default&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 530 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:21.699571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d8e-f522-4b86-b802-65cd9c9e3c78 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.699870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d8e-f522-4b86-b802-65cd9c9e3c78 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.700142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d8e-f522-4b86-b802-65cd9c9e3c78 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.701977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 26/53] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:21.708275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.708589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.708868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.728411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:21.729633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:21.738751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 28/54] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:21.762934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d8e-f522-4b86-b802-65cd9c9e3c78 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:21.777387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d8e-f522-4b86-b802-65cd9c9e3c78 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:21.782835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:21.783664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.783946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.784234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.785548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:21.787273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6051-06da-4078-8318-b343f1c210cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:21.788960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:21.795203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:21.804781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f6c27-36e6-4007-a970-220ad58a044e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:21.810692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:21.811369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:21.811653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:21.811929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:21.812817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:21.814134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:21.814134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:21.814134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:21.815157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42a80-3f5d-4f88-96ea-2bc4c34f394c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:21.845787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 29/56] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Dec 15 16:07:21 2021] POST /identity/v3/projects => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:24.283614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8269ca-bbf9-4e74-8105-6bfa585a9501 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:24.284161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8269ca-bbf9-4e74-8105-6bfa585a9501 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:24.284161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8269ca-bbf9-4e74-8105-6bfa585a9501 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:24.285983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 28/57] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:24.293172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:24.293591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:24.293702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:24.313260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:24.314530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:24.376566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 30/58] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:24.402021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8269ca-bbf9-4e74-8105-6bfa585a9501 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:24.416075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8269ca-bbf9-4e74-8105-6bfa585a9501 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:24.420912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:24.421723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:24.422207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:24.422447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:24.423694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:24.425538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30a8c-d37f-427f-ba27-647a3c513367 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:24.427221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:24.433480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:24.443951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522c2f9-b346-4466-b3ed-27ddf2e8fdf7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:24.448956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:24.449621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:24.449910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:24.450184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:24.450912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:24.451948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:24.451948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:24.451948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:24.453525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941ef46-abd2-419a-be55-0da94664ec9f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:24.483631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 31/60] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:24 2021] POST /identity/v3/users => generated 275 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:28.580713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518e4d-795d-4e14-a862-bd3318181307 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.581323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518e4d-795d-4e14-a862-bd3318181307 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.581683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518e4d-795d-4e14-a862-bd3318181307 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.585369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 30/61] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:28.591791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163253e5-f5f7-4450-8c9e-5f91617ad793 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.592336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163253e5-f5f7-4450-8c9e-5f91617ad793 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.592336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163253e5-f5f7-4450-8c9e-5f91617ad793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.628182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-163253e5-f5f7-4450-8c9e-5f91617ad793 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:28.630401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-163253e5-f5f7-4450-8c9e-5f91617ad793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:28.656904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 32/62] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:28.690570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518e4d-795d-4e14-a862-bd3318181307 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.695985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421240b-c380-4dad-b846-d696db3093af None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.696269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421240b-c380-4dad-b846-d696db3093af None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.696860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421240b-c380-4dad-b846-d696db3093af None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.699447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 33/63] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:28.706726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067705-7688-4be1-9efe-6f95533c53a5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.708921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067705-7688-4be1-9efe-6f95533c53a5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.709213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067705-7688-4be1-9efe-6f95533c53a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.717580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518e4d-795d-4e14-a862-bd3318181307 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.722979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.724161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.724703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.725184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.737439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:28.744891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:28.746811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 31/64] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:28.753628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-81067705-7688-4be1-9efe-6f95533c53a5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:28.753838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.755216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81067705-7688-4be1-9efe-6f95533c53a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:28.765757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817656d7-6d75-4a92-8180-4aeb1eeabb5d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.771579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.772621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.772918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 34/65] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:28.773124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.773533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.774380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:28.775041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadf2b-c886-4452-9d80-d1072056a848 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.775561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadf2b-c886-4452-9d80-d1072056a848 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.775996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadf2b-c886-4452-9d80-d1072056a848 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.780888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.782943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 35/66] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:28.783073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.784802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.785121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.785366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.800461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 32/67] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:28.811945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.813879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:28.815099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:28.825934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7e69-0a69-4c31-8849-128d3647dda6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.827417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 36/68] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:28.829066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.834433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.837573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.837862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.838143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.846650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37826ab-a811-41a2-af64-fdc6086b3a06 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.856594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.857745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.858338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.858735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.859052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.860918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.861380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.863106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.865059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 37/69] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:28.866165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.868770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 33/70] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:28.870305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.881449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274fa60-1a66-479f-8a30-468ded588863 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.881777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c278-e737-4c4d-ad44-4c044cf79af5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.886805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.887476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.887940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.888368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.888615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.888997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.889159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.889471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.898713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.900875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.902407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:28.909744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:28.911493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 38/71] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:28.912548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.917472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 34/72] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:28.923052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.931206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c99c2e-db1c-4300-ab78-9965a3c16105 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.933896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93eec3-799d-43a4-bc0d-085fabe2631e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.936470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.937544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.938089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.938616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.939112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.939780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.939999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.940380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.940787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.941659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:28.942069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.942719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.943867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.953366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 35/73] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:28.959786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.967720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 39/74] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:28 2021] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:28.972664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76250add-9e7a-4686-b3cc-9dace71e8bf2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:28.973472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:28.986763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:28.988040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:28.988570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:28.989084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:28.990922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:28.994022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:28.999815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1354a1-e273-4318-848e-6b30a0c81fe4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.006871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 36/75] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.009995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.018371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.019668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.020142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.020680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.024332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.026497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.037307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:28 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.037926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006ed5-f85f-4df8-87cd-e80331e501f4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.042475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.047233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.047946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.048229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.048538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.049401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.049720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.054084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad95f7e-e66a-4e7c-8ca6-42d30c042bc2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.065883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6a52-ee0d-457a-b6df-7df7aed347d7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.068531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 37/77] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 259 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.070382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566703-a924-432a-9179-3fdbd79dfb90 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.071156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566703-a924-432a-9179-3fdbd79dfb90 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.071863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566703-a924-432a-9179-3fdbd79dfb90 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.076048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 38/78] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:29.080851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.081946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.082458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.082937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.086994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.087393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.087879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.105829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.108001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.118458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:29.120800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:29.127933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 41/79] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:29.139964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.148665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 39/80] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:29.152747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06a0c-eb5e-4d8b-bb92-b2011f0d1923 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.163563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.164647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.164977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.165260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.167273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.169616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.171811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 42/81] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.182805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.193608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.195720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513910c-85e6-4c3d-a5e5-38cea4a31b84 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.207242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910aa1-9eb4-4a1c-a444-d311f462a790 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.214711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.215805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.216654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.217122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.218610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=22207ac88e304d2bb4d51c7880d43bd3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.219163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.222748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.223021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9298ec-2946-4176-b3bf-996012047255 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.223625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.223909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.224186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.233712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 40/82] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/role_assignments?user.id=22207ac88e304d2bb4d51c7880d43bd3&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:29.236660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb0e9-9b67-48ae-a69d-d49b18490314 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.237478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb0e9-9b67-48ae-a69d-d49b18490314 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.238089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:29.238418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb0e9-9b67-48ae-a69d-d49b18490314 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.241829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 41/83] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:29 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:29.245625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-aad7c958-97bb-4499-ab41-4842481fe61f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:29.247324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 43/84] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:29.257918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb0e9-9b67-48ae-a69d-d49b18490314 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.265350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.266822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.267321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.288081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:29.289861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:29.291091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb0e9-9b67-48ae-a69d-d49b18490314 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.299949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 44/85] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:29.310660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.311790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.312261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.312979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.314359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.314872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.317945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.328385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.340411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 42/86] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.345158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa47c2-5afe-4401-8c37-5910df7a1885 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.352332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.355856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.360197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.361350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.362115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.371920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a30e-9abe-4126-a646-294500ee989c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.383643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:29.390943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.391667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.391955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.392236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.394433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.396837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.398663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 43/87] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.401094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:29.403529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 45/88] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:29.409770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.411824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.428064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1423c-153a-4651-b577-0fe3e49ea4b5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.430201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d97f6-6e62-424f-b834-136ba376ef2e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.437324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.438277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.438545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.438851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.441420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.442534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.442991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.443440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.444854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.445418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.448448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.460221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.465194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.467558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 46/89] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.475935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.490146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 44/90] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:29.501422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f8a-c090-436f-99f2-b01b9097c974 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.502002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.508723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.510153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.510596 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.511044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.513297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.517336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.520288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 47/91] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.524159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fe6a-be77-46ba-9617-63f46af36ba8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.527064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.543697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.545179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.545642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.546089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.546312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202b516-3a18-4aba-ad36-4dc5da00a1f1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.550700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.553551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.554577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.554757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.555017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.555472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.557725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:29.567757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.571351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.574620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.592948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda82fc-649d-4315-a313-3add7f99d01b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.593564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 48/93] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:29.602612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.611037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.612118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.612645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.613089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.613567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86334-5cd7-497f-8ebf-7514adeefeec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.614558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.615088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.618382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.622864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.625147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.625980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.627127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] PATH_INFO: `/v3/projects/d91dd49558c14ff89966aadd86eeb6ce` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.630293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] RBAC: Authorizing `identity:get_project(project_id=d91dd49558c14ff89966aadd86eeb6ce)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.636168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb619d-f534-42af-9370-2ce4a061bd8b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.638528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 46/94] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 259 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:29.642168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 49/95] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/projects/d91dd49558c14ff89966aadd86eeb6ce => generated 312 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:29.654275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:29.682907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ad92-5a22-4fc7-b559-9e3a6cf5f540 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:29.694482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:29.695183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:29.695470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:29.695747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:29.696759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=d91dd49558c14ff89966aadd86eeb6ce, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:29.697085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:29.699076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1fa1-ac76-4998-b71c-309e9fb1f107 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:29.709872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 47/96] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:29 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=d91dd49558c14ff89966aadd86eeb6ce&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.081064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec357-5b03-4482-886b-c577d0ea3187 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.081604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec357-5b03-4482-886b-c577d0ea3187 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.081604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec357-5b03-4482-886b-c577d0ea3187 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.083554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 50/97] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:33.089793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d896-fd55-444a-a393-17b669362710 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.090642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d896-fd55-444a-a393-17b669362710 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.091117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d896-fd55-444a-a393-17b669362710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.116183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7a36d896-fd55-444a-a393-17b669362710 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:33.123354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7a36d896-fd55-444a-a393-17b669362710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:33.136153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 48/98] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:33.175437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deec357-5b03-4482-886b-c577d0ea3187 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.195030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deec357-5b03-4482-886b-c577d0ea3187 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.204016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.204854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.205139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.205487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.224680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:33.231607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:33.237386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 51/99] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:33.246611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d896-fd55-444a-a393-17b669362710 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.261736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d896-fd55-444a-a393-17b669362710 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.273161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.274274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.274765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.275253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.276261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:33.276820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.278768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.293649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 49/100] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.303171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.320054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348ec1-0e30-4ed2-bbee-8b30bf015d82 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.324883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.325773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.326058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.326334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.329378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.331326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.333482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 52/101] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.342808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.358179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b28d0-0d06-40a2-9fab-69a1de31c029 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.369373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.370618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.371097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.371565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.377352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.379875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56946b12-b6ae-464f-8436-0cf30a33e573 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.382274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 50/102] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.392069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.411937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd42a-1c63-4b33-99ed-2dd9401d9e2c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.413756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4ec9-1845-4cb8-b328-301648fc124d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.414253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4ec9-1845-4cb8-b328-301648fc124d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.414751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4ec9-1845-4cb8-b328-301648fc124d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.417009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 51/103] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:33.418281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.419286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.419571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.419852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/22207ac88e304d2bb4d51c7880d43bd3/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.424582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, user_id=22207ac88e304d2bb4d51c7880d43bd3, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.425236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.425628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:33.425628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:33.425628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:33.426125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.426604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.427599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.455296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 53/104] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:33 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/22207ac88e304d2bb4d51c7880d43bd3/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:33.465743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:33.467663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:33.562521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 52/105] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:33.599165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.611951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a43f1-d50f-478c-ad88-c27a998a5077 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.620968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.621798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.622081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.622355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.638219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:33.649642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:33.651120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 54/106] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:33.658132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.673806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50864644-b93f-42f0-a1d1-8ce73f47bee9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.685019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.686200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.686720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.687191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.688730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:33.689284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.691176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.707551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 53/107] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.714540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.726177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd052-f2e6-4c9c-9ded-99aeec9e561e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.737225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.738140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.738426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.738703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.745224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.747447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.749467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 55/108] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.756146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.769491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5828b31-4a5c-4b7e-b184-cd7359d309fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.781670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.783102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.783622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.784096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.786369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.788912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf3b2e-df70-476f-af66-3b151b00b750 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.791002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 54/109] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:33 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:33.797864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:33.816658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983b2a3-b65a-475d-b5da-e1278ade8702 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:33.825091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:33.826030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:33.826317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:33.826602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:33.834277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, user_id=a4c96f5c750e48ad8c7f85758fc25fcc, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:33.837231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ebd5b-5b73-4fa5-bf40-003c2fa680d2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:33.864457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 56/110] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:33 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:34.069184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe019c-61e0-44e2-95d7-f497dd8b07b3 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.069852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe019c-61e0-44e2-95d7-f497dd8b07b3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.070325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe019c-61e0-44e2-95d7-f497dd8b07b3 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.072655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 55/111] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:34.079971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.080662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.081175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.103615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:34.105356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:34.194151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 57/112] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:34.245577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe019c-61e0-44e2-95d7-f497dd8b07b3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.263240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe019c-61e0-44e2-95d7-f497dd8b07b3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.271990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.273336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.273863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.274435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.292522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:34.301024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:34.302674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 56/113] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/roles/reader => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:34.313105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.326677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4331a-d731-4b46-b4e1-819e6bf6567b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.332885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.334022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.334522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.335030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.336180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:34.336866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.338898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.355119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 58/114] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:34.364511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.378166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ebfd4-6a6a-4fbe-9b8a-7113957fcf51 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.384760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.386073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.386582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.387170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] PATH_INFO: `/v3/users/f3fba69d39244c33bcf80b938dbda3c0` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.406580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3fba69d39244c33bcf80b938dbda3c0)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.409468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371c59-315c-4694-b3e7-59ee9021ff21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.411575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 57/115] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/users/f3fba69d39244c33bcf80b938dbda3c0 => generated 289 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:34.421257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.433717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911c4-18c7-4c9b-8126-c4d903edad3f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.439700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.440747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.441315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.441784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.444861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2770-1342-44a6-9dcd-bfae358635db None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.445444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2770-1342-44a6-9dcd-bfae358635db None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.445930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2770-1342-44a6-9dcd-bfae358635db None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.448265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 58/116] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:34.455443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.456084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.456768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.467210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.470678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.480886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:34.482918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:34.496491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 59/117] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:34.499782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 59/118] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:34.503643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.528898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.531239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13fb1-ad38-4c19-beef-98f087efc18b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.540974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743003b2-0bf0-401e-ba56-30a1c4727d00 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.546470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.548503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.549143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.549659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.551303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.553481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.554803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.555986 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 60/119] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:34.556210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.557913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.557913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.559437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.563498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.566872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:34.571897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.575511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:34.591609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba43e4-4504-4d91-a1e9-ac9564973f5d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.598435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ae311-6f3f-41b6-bef9-f3e752b4345e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:34.598758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.599550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.599931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.600307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.604483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.604483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec6cb4-cb5a-45dd-a964-c7b8f8529131 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.621594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:34.623073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.623793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.624498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.626455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=f3fba69d39244c33bcf80b938dbda3c0) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:34.627263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:34.631244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b306d9-b9ab-4ed0-b931-e472dc2fc9c7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:34.655864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:34 2021] GET /identity/v3/role_assignments?user.id=f3fba69d39244c33bcf80b938dbda3c0&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=6578e00baa8946f69479551803fdf4a5 => generated 259 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:34.660666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 61/122] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:07:34 2021] POST /identity/v3/projects => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:34.835838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9267a0-ebe5-4c80-aa8d-4d94fbe80b6a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.836733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9267a0-ebe5-4c80-aa8d-4d94fbe80b6a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.837446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9267a0-ebe5-4c80-aa8d-4d94fbe80b6a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.841211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 62/123] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:34 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:34.849474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55225-b3ac-4250-942e-20c4a59cad2e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:34.850347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55225-b3ac-4250-942e-20c4a59cad2e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:34.851085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55225-b3ac-4250-942e-20c4a59cad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:34.893245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ced55225-b3ac-4250-942e-20c4a59cad2e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:34.895821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ced55225-b3ac-4250-942e-20c4a59cad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:35.026832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 62/124] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:35.054227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9267a0-ebe5-4c80-aa8d-4d94fbe80b6a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.062289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf6923-b5b7-47d4-a67d-dbdf2c15c966 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.062620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf6923-b5b7-47d4-a67d-dbdf2c15c966 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.062908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf6923-b5b7-47d4-a67d-dbdf2c15c966 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.065105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 63/125] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:35.076472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.076472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.076472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.090957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9267a0-ebe5-4c80-aa8d-4d94fbe80b6a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.096152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:35.097454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:35.105820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 64/126] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:35.107663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.109115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.109821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.110435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.135339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.142333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aabef7-7d52-4851-906f-d2bb9c92cfcb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.147115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:35.149075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.149915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.150199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.150476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.157158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:35.158884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 63/127] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:35.165394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.166638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:35.174143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:35.175428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 65/128] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:35.183182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec465c-e924-46c8-bc54-ab6166bd9b50 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.185611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.188852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.189572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.189931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.190215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.191133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:35.191450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.193406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.204101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd23c9-5cea-418b-8a5b-cdbfa49591e1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.211012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 64/129] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:35.212915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.213442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.213618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.214003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.214289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.215104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:35.215418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.221718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.226079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0227ba-79ca-4470-8060-206a53e448f5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.231352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.233077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.233702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.234043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.235648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.236574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 66/130] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:35.241979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.243039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.244746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 65/131] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:35.258267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f0cc-e064-4d45-8c56-4a95b072ad9e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.261829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.264500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.265404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.265761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.266113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.267893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.270233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.272079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 67/132] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:35.278592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.281422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e49d3-58ca-4102-9955-614e754ba66b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.286299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.287190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.287479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.287759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.289100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.290128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed9345-37c6-4a57-b90c-a5cae4d77e0c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.291343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.294432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 66/133] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:35.301665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.302570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.302912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.303198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] PATH_INFO: `/v3/projects/d91dd49558c14ff89966aadd86eeb6ce` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.307318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] RBAC: Authorizing `identity:get_project(project_id=d91dd49558c14ff89966aadd86eeb6ce)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.309673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.311921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 68/134] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:35 2021] GET /identity/v3/projects/d91dd49558c14ff89966aadd86eeb6ce => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:35.313607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.325092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8812-d258-4a52-a932-15c229578ac8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.332212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.333225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.333513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.333798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.337373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, user_id=a4c96f5c750e48ad8c7f85758fc25fcc, role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.340296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf17d-ef14-4493-b87e-c2e9183e7795 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.346437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:35.366121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92680-716e-417d-956c-c90f25be620d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:35.376835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 67/135] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:35 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:35.459351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:35.460262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:35.460590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:35.460875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] PATH_INFO: `/v3/projects/d91dd49558c14ff89966aadd86eeb6ce/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:35.463130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91dd49558c14ff89966aadd86eeb6ce, user_id=a4c96f5c750e48ad8c7f85758fc25fcc, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:35.466171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6267de-bdaa-4c52-855c-ab831248771d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:35.492350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 69/136] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:35 2021] PUT /identity/v3/projects/d91dd49558c14ff89966aadd86eeb6ce/users/a4c96f5c750e48ad8c7f85758fc25fcc/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:37.461824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ed5f-150f-4d39-909b-d1885c8fa181 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.462718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ed5f-150f-4d39-909b-d1885c8fa181 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.462718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ed5f-150f-4d39-909b-d1885c8fa181 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.464450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 68/137] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:37.471217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.472158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.472158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.501765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:37.503013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:37.584572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 70/138] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:37.628870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ed5f-150f-4d39-909b-d1885c8fa181 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.652535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ed5f-150f-4d39-909b-d1885c8fa181 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.658944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.659889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.660165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.660464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.673393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:37.680447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:37.681760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 69/139] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:37.691943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.707064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5bebc-3bed-469c-a2f9-16b340d29e74 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.717398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.718489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.719055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.719535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.720546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:37.721055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:37.722934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:37.738981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 71/140] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:37.749098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.774106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61269-0f14-4f7f-b973-9b92de9f46de admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.786688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.788188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.788701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.789195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] PATH_INFO: `/v3/users/22207ac88e304d2bb4d51c7880d43bd3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.793749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] RBAC: Authorizing `identity:get_user(user_id=22207ac88e304d2bb4d51c7880d43bd3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:37.797282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:37.800827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 70/141] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/users/22207ac88e304d2bb4d51c7880d43bd3 => generated 247 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:37.810020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.826210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a4279-47cf-4d9d-b9ea-8870403bbc0d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.836864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.837994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.838481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.839016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.853267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:37.855555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:37.870337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 72/142] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:37.880707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.905335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebc7e8-c8b5-4581-8406-1730a7e2206f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.929020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.930600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.931068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.931558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.937919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:37.942237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76749b-5357-4671-945b-5bf893bf6345 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:37.945940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 71/143] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:37.955973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:37.972582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84212a17-02b9-441e-bb9b-f95f905d0454 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:37.982047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:37.983100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:37.983603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:37.984090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:37.985455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=22207ac88e304d2bb4d51c7880d43bd3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:37.986038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:37.989667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24999c0d-992d-4ded-8b89-a04f2069bb1f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:38.008688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 73/144] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:37 2021] GET /identity/v3/role_assignments?user.id=22207ac88e304d2bb4d51c7880d43bd3&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:38.609273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589ccc-e315-42e6-adc5-c640563cc253 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.610400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589ccc-e315-42e6-adc5-c640563cc253 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.610904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589ccc-e315-42e6-adc5-c640563cc253 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:38.614951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 72/145] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:38.622141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.622698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.623135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:38.664758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:38.666662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:38.688120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 74/146] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:38.728641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589ccc-e315-42e6-adc5-c640563cc253 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:38.755547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589ccc-e315-42e6-adc5-c640563cc253 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:38.766805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:38.768168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.768693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.769198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:38.793733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:38.807400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:38.809506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 73/147] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:38.819820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:38.842454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e1e3e-1896-4640-a1ee-a28797e9535d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:38.855102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:38.856269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.856807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.857307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:38.858780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:38.859486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:38.866860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:38.883378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 75/148] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:38.892963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:38.916733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aced9-da89-473c-953f-045c1bd42612 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:38.929503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:38.930863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.931306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.931720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:38.937906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:38.941726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669153-6a4e-4bc5-b1c8-8b21ac8b8d25 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:38.944804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 74/149] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:38 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:38.954149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:38.973531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343347e-d0b7-4f5f-873f-68d5d645e30e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:38.983464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:38.985123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:38.985623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:38.986094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.002118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad579-3e7b-4c0e-aa91-1a1b1ed145ee None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.002593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad579-3e7b-4c0e-aa91-1a1b1ed145ee None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.007344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad579-3e7b-4c0e-aa91-1a1b1ed145ee None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.007599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.010760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.010983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 75/150] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:38 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:39.018435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.018864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.019314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.026718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:39.058322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.074140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:39.076060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:39.079989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d9c6-9466-4771-aaae-88956e6a9406 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.095179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.097645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.098129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.098620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.101827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 76/152] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:39.103331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.107345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.111433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 77/153] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.121412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.140865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.149763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608542c-3f1e-4d52-90f9-bf11ae69daac None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.158402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.159487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.159971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.160483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.161721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:39.162238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.162808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842fdd-4884-4f4c-a74f-d880357c6b50 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.164726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.181737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.183090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.183538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.183972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.185402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 77/154] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.186620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.189872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4c69-0ed0-4e0a-853e-a6f52a4ec58f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.193117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.203465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.225927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb921-b619-4c78-82ff-f7c5d324d247 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.239468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.240650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.241105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.241589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.242876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.246617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798fd0-e02d-4ec2-aae0-109ffd84c9f2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.297471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 78/156] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:39 2021] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:39.419087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f04e-86be-4b9a-aba4-4e8e1a9200cb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.419445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f04e-86be-4b9a-aba4-4e8e1a9200cb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.419897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f04e-86be-4b9a-aba4-4e8e1a9200cb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.423383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 79/157] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:39.429843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.430151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.430425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.457822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:39.459232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:39.472038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:39.484601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc92c5-131a-4293-ad6e-884573f6b855 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.485032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc92c5-131a-4293-ad6e-884573f6b855 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.485484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc92c5-131a-4293-ad6e-884573f6b855 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.490944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 80/159] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:39.497466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.500950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.501872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.502507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.511469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9031cf-9b07-40a2-9c95-f5bc52a0bede None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.537246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.538180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.538380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.538660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.544558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:39.547114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:39.562409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:39.567289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 81/160] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:39.581489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:39.584199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 80/161] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:39.593869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.608499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.612194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38878234-0fe0-495e-bff3-8f93a8520fab None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.625136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.629238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.631348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.632699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.636872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:39.639152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33424a02-8b5a-43c3-bda3-03725b9e3dea admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.640910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.646346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.663238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.666080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.666873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.667580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.670885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 82/162] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.678692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.694099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223b164-4fba-4876-a109-dbcf507d967a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.695033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:39.703988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.704951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.705244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.705496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.706861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.709129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.711232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 83/163] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.713429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:39.715509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 81/164] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/roles/reader => generated 84 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:39.722054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.725511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.743094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39069-f29f-45fd-b2cf-b77d65c024fc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.743465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8ce6-7639-4437-b2da-96ec03899a78 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.750812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.751492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.751597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.751827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.752045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.752869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.753328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.753797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.755268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:39.755792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.758727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.765827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.767960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.775553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 82/165] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:39.778948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 84/166] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:39.783522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.789248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.800294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3c7c1-81a3-424a-87f4-2366e3b8a210 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.802151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac2dff-c8e4-47a0-9928-13280b84792f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.809943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.810862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.811144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.811422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] PATH_INFO: `/v3/users/f3fba69d39244c33bcf80b938dbda3c0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.813893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3fba69d39244c33bcf80b938dbda3c0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.816277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.818387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 83/167] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/users/f3fba69d39244c33bcf80b938dbda3c0 => generated 289 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.820025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.820957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.821236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.821505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] PATH_INFO: `/v3/projects/d91dd49558c14ff89966aadd86eeb6ce` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.825640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.825994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d91dd49558c14ff89966aadd86eeb6ce)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.830342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.833534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 85/168] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/projects/d91dd49558c14ff89966aadd86eeb6ce => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.843775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.845296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c28-1355-4ae3-947b-ba06bbb0ffb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.852948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.856340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.856340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.856340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.856340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.858218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.860951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 84/169] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:39.861846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a22bf-26c5-4655-beca-0022d4fca7b2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.867616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:39.870386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.871126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.871404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.871681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.872683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=d91dd49558c14ff89966aadd86eeb6ce, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:39.873008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.875439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577cf21-26ef-4a41-9439-d0fb3d4c737a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.879927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f8737-d2e0-4d71-a49d-45b906c4e61d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:39.883690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 86/170] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:39 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=d91dd49558c14ff89966aadd86eeb6ce&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:39.894438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:39.895389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:39.895670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:39.895943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/f3fba69d39244c33bcf80b938dbda3c0/roles/6578e00baa8946f69479551803fdf4a5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:39.902299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, user_id=f3fba69d39244c33bcf80b938dbda3c0, role_id=6578e00baa8946f69479551803fdf4a5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:39.905264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447214c1-9ecc-45a2-9c54-fcbd2e0249af admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:39.925631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 85/171] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:39 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/users/f3fba69d39244c33bcf80b938dbda3c0/roles/6578e00baa8946f69479551803fdf4a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:07:40.407493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0866-7f2a-4b34-910e-b1050765b5c5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.407871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0866-7f2a-4b34-910e-b1050765b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.408183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0866-7f2a-4b34-910e-b1050765b5c5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.410043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 87/172] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:40.417522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.417864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.418084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.443268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:40.444499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:40.547192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 86/173] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:40.597188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a0866-7f2a-4b34-910e-b1050765b5c5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.618810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a0866-7f2a-4b34-910e-b1050765b5c5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.625640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.626547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.626747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.627021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.648851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:40.660573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:40.662240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 88/174] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:40.668382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.678632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48cd5-fa4d-4765-ae74-9a73b686eacd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.690014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.690706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.690986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.691260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.692091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:40.692400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:40.694067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:40.709487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 87/175] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:40.715427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.729916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21824de-8a9c-4244-8ba9-b61ef8b8edf2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.740891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.741795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.742076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.742352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] PATH_INFO: `/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.745281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] RBAC: Authorizing `identity:get_user(user_id=a4c96f5c750e48ad8c7f85758fc25fcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:40.747464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:40.749547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 89/176] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/users/a4c96f5c750e48ad8c7f85758fc25fcc => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:40.756195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.767623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957d2b-1191-4633-b08f-843184f20b83 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.782611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.783294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.783629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.783903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.794435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:40.796246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:40.816415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 88/177] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:40.822762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.843463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28749-4a53-47a5-a23a-7751b0b43a9e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.852811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.853699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.853970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.854236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.861518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:40.863663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ad2b8-e1bc-4ffd-95ff-d414901368a9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:40.865548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 90/178] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:40.872082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:40.884107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a659a6-1a8e-4e38-9d1b-8e078737c84b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:40.889150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:40.890199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:40.890720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:40.891189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:40.892268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=a4c96f5c750e48ad8c7f85758fc25fcc) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:40.892868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:40.900461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee878ce-55d9-44fd-ac68-08f6517f5ed9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:40.908219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 89/179] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:40 2021] GET /identity/v3/role_assignments?user.id=a4c96f5c750e48ad8c7f85758fc25fcc&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:42.275785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29379010-70e0-424e-bee3-ade2c7d69011 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.276335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29379010-70e0-424e-bee3-ade2c7d69011 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.276335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29379010-70e0-424e-bee3-ade2c7d69011 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.278467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 91/180] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:42.285029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.286003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.286500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.305975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:42.307557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:42.315826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 90/181] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:42.340798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29379010-70e0-424e-bee3-ade2c7d69011 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.355079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29379010-70e0-424e-bee3-ade2c7d69011 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.359957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.360855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.361134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.361406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.374606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:42.381648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:42.388422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 92/182] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:42.389934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.404490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e2f9-8dc6-403a-91a5-f0d771b3894f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.409389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.410182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.410532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.410928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.411794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:42.412168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:42.413925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:42.428243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 91/183] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:42.435200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.448315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c697-0ac2-431b-97ab-303f7698e983 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.453171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.454090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.454473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.454758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.471959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:42.474337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:42.476666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 93/184] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:42.483099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.494652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7cf0b-d04d-4b70-800d-3668164061e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.499669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.500916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.501609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.502085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.511717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:42.513943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:42.528694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 92/185] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:42.539288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.550414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45bd8-d566-4117-9293-90bd887b8ee4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.554944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.555819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.556096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.556363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.557656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:42.559735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d084a-c91d-4d2b-94ef-ff113fd1bea3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:42.561525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 94/186] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:42.572386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:42.588706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ead13-e947-4cb3-97e8-ecb1ebf5124a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:42.596488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:42.597586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.598073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.598540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.600145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=a3959e18da7745f8b9e59b7e3f837e3e) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:42.600715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:42.604377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2140b9b-5dbb-4689-a6e8-2be2571ca42b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:42.617667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 93/187] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:42 2021] GET /identity/v3/role_assignments?user.id=a3959e18da7745f8b9e59b7e3f837e3e&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:42.920099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c897f1-d95e-4719-9243-44e5f7e93112 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.920501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c897f1-d95e-4719-9243-44e5f7e93112 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.920677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c897f1-d95e-4719-9243-44e5f7e93112 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.922997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 95/188] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:42.929372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.929654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.929931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.953449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:42.955398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a800b-be16-43f0-be9c-85c0353fa68b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.955535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:42.956007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a800b-be16-43f0-be9c-85c0353fa68b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.956499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a800b-be16-43f0-be9c-85c0353fa68b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.958500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 96/189] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:42.968417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e573ff-ac5f-4eb0-a242-25e8c3ea56dc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:42.969133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e573ff-ac5f-4eb0-a242-25e8c3ea56dc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:42.969618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e573ff-ac5f-4eb0-a242-25e8c3ea56dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:42.973342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 94/190] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:42.988750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c1e573ff-ac5f-4eb0-a242-25e8c3ea56dc None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:42.990345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c1e573ff-ac5f-4eb0-a242-25e8c3ea56dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:42.998240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 97/191] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:43.008314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.019306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6ad3-88bb-42e5-ab87-2da8bfda66b5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.024172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.025339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.025878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.026355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.038488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:43.044566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a2e7-512b-4b9b-8359-b6297cbe2c46 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.045136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a2e7-512b-4b9b-8359-b6297cbe2c46 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.045605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a2e7-512b-4b9b-8359-b6297cbe2c46 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.047875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 98/192] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:43.048000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:43.049059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a2e7-512b-4b9b-8359-b6297cbe2c46 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.049261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 95/193] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:43.055804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.063502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a2e7-512b-4b9b-8359-b6297cbe2c46 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.066004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80385f-4ee4-43cf-90d4-953c2c5aecf4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.068341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.069206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.069475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.069731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.071110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.071775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.072066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.072342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.073145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:43.073460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.075085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30b7ac-c6a6-4c2d-8065-097685c2be32 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.082831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:43.088579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 96/194] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.088579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.088579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.088579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.090199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:43.091729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 99/195] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:43.098575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.109181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db858-4e2b-4d5e-a676-0a18340d5889 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.110860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:43.112163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:43.113855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.114709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.114977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.115314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] PATH_INFO: `/v3/users/f3fba69d39244c33bcf80b938dbda3c0` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.116509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3fba69d39244c33bcf80b938dbda3c0)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.121481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.121481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 100/196] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/users/f3fba69d39244c33bcf80b938dbda3c0 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:43.122748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:43.128471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.129935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.138238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076217-5305-4dd0-901f-8f4be02e38f5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.141625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872ce00-a0f0-4770-934b-6c1d32b0b97a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.143685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.144718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.145153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.145553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.146343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.146661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:43.147042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.147402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.147568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.147665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.149817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.159473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.161883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.162387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 101/198] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.173141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 98/199] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:43.173357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.173947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.184933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0fc2e-f7c8-4715-b06d-8ce2d83b75e3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.189661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.189871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34771ffd-8cde-4990-9398-e0e9e5ba8071 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.190546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.190882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.191233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.192367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.194514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.194711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.195417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.195811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.204803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.205000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 99/200] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.205000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.205774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.207896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.209666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 102/201] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.211721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.215625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069055-529b-43ce-a953-59be42c7abcd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.220530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.221398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.221676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.221949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.223180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.225276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.226039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16000-1018-4a54-8f06-830b4f5b10c1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.227200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 100/202] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.227725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.237262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.237899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba530cb-b98b-436c-94a7-5fda870c2b8f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.238088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.238372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.238706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.242624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.243307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.243584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.243857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.244630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.246570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.248483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.250364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.268479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 103/203] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:43.268479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.274007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 101/204] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:43 2021] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:43.274711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.286578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5ab8-4e52-4cc1-a3fa-ac5a96ce1a10 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.289679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc54b9a-6553-4246-95ae-32dbed7b9107 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.293173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.294294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.294621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.295020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.296620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.298981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.301034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 102/205] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.305170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.306265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.306781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.307245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.308451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, scope.project.id=4cd7b955df6e4eb192e35637959278aa, user.id=f3fba69d39244c33bcf80b938dbda3c0) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:43.308995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.311333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:43.313107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79c4f-c9cd-4f8e-b123-4de5dbcf8ecf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.320516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 104/206] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/role_assignments?user.id=f3fba69d39244c33bcf80b938dbda3c0&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=6578e00baa8946f69479551803fdf4a5 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:43.342408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d439-0dbf-4aaa-aae8-4a9fa2faa68a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:43.352089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:43.354000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:43.354797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:43.355454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:43.357448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=a3959e18da7745f8b9e59b7e3f837e3e) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:43.358324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:43.362758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862169f-3daa-4393-95b7-8d1b4bf6f346 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:43.374820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 103/207] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:43 2021] GET /identity/v3/role_assignments?user.id=a3959e18da7745f8b9e59b7e3f837e3e&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:45.162102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c5a7-0c5e-4c1f-a237-7419ea77f4ae None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.162861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c5a7-0c5e-4c1f-a237-7419ea77f4ae None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.162861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c5a7-0c5e-4c1f-a237-7419ea77f4ae None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.164934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 105/208] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:45.171868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.172716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.172716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.192396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:45.193645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:45.201884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 104/209] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:45.225309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c5a7-0c5e-4c1f-a237-7419ea77f4ae None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:45.239010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c5a7-0c5e-4c1f-a237-7419ea77f4ae None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:45.243534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:45.244338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.244699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.244954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.257056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:45.263895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:45.265172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 106/210] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:45.271830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:45.281581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af644fac-1ee6-429d-b8ea-55e3d6dffdb3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:45.286425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:45.287111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.287387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.287658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.288473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:45.288788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:45.290421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:45.300178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 105/211] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:45.306418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:45.317575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc429-c381-4898-a1ce-0e186dc97378 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:45.322261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:45.323153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.323428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.323681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.325028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:45.327213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:45.329555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 107/212] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:45 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:45.335823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:45.347459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3165e62-dc19-47a8-88d3-169790f409b7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:45.352295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:45.353236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.353512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.353784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.355177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:45.357405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e20077-ba81-4437-84ef-40193aac6dd9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:45.359669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 106/213] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:45 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:45.366198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:45.376989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e3ac-0e36-44ca-b6ca-5df1e3d77f21 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:45.382045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:45.382978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.383252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.383519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/a3959e18da7745f8b9e59b7e3f837e3e/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.385755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, user_id=a3959e18da7745f8b9e59b7e3f837e3e, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:45.388499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf365fb-4155-4ef6-9a01-d4663dba996c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:45.406688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 108/214] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:45 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/a3959e18da7745f8b9e59b7e3f837e3e/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:07:45.899141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18235-21fb-40b5-bfea-072ce0bb1aa5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.899581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18235-21fb-40b5-bfea-072ce0bb1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.899831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18235-21fb-40b5-bfea-072ce0bb1aa5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.901633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 107/215] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:45.908543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:45.908950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:45.909177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:45.929246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:45.930479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:45.995037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 109/216] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:46.024900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18235-21fb-40b5-bfea-072ce0bb1aa5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.038343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18235-21fb-40b5-bfea-072ce0bb1aa5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.042985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.043805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.044062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.044335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.056907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:46.064086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:46.065448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 108/217] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:46.072043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.081979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff7577-1f4a-4b36-a65f-5b7b367c5e75 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.086791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.087490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.087761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.088073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.088887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:46.089182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.090900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.101551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 110/218] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:46.107875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.119520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb9c6-411b-4a0a-8549-acfd6989a45f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.128496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.128496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.128496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.128496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] PATH_INFO: `/v3/users/26d376fd59a64c3899c71de47700f6f7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.144010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] RBAC: Authorizing `identity:get_user(user_id=26d376fd59a64c3899c71de47700f6f7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.146383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.148410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 109/219] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/users/26d376fd59a64c3899c71de47700f6f7 => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:46.155609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.167061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f8-371b-4b9c-b8bd-d5f90f98e79b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.173207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.173890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.174213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.174549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.185152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.187005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.197526 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 111/220] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:07:46.203802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.214442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a33ca-8a46-4fdb-84a4-66b26aa05901 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.219724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.220640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.220918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.221188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.222488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.224609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d9e3-7405-4655-be02-8dc4e8871436 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.226694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 110/221] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:46.233142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.247462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cc48a-2da2-4676-9caa-248d630e3b45 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.252212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.252932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.253207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.253478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.254321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=26d376fd59a64c3899c71de47700f6f7) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:46.254625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.256499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bce2-3473-4aa6-91bd-c203aebf2138 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.262864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 112/222] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/role_assignments?user.id=26d376fd59a64c3899c71de47700f6f7&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:46.647582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e90565-ebb1-4fb3-ba65-f45aa056c89b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.648288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e90565-ebb1-4fb3-ba65-f45aa056c89b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.649040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e90565-ebb1-4fb3-ba65-f45aa056c89b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.652057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 111/223] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:46.659754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.660357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.660951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.680795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:46.682392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:46.696629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 113/224] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:46.715225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e90565-ebb1-4fb3-ba65-f45aa056c89b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.729288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e90565-ebb1-4fb3-ba65-f45aa056c89b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.734410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.735616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.736079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.736554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.749711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:46.757768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:46.759294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 112/225] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:46.766399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.780120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be67b-2651-43b6-a290-051ed97208f1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.785251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.786166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.786616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.787057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.788009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:46.788580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.790424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.799841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 114/226] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:46.806517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.817578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9592-b66a-4114-b6df-2e988e97cc9b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.822687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.823912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.824372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.824841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.826426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.829036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.834914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 113/227] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:46.838034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.849685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5f63b-b0e9-4b98-83d5-979a29ef8f6b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.854887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.856143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.856628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.857065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.858679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.861379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e59e-85cc-4ba7-9b10-6159eb2ddef1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.868602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 115/228] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:46 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:46.870516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:46.881449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121aafd-e22d-4b4e-838a-ab5538693c87 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:46.886581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:46.887891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:46.888351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:46.888835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/a3959e18da7745f8b9e59b7e3f837e3e/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:46.892037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, user_id=a3959e18da7745f8b9e59b7e3f837e3e, role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:46.895074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d8d15-1934-4e0e-beef-ac8c248d4dd1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:46.912635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 114/229] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:46 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/a3959e18da7745f8b9e59b7e3f837e3e/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:47.506556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab57fd-6fb8-458a-9c37-bfb75eb76beb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:47.507084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab57fd-6fb8-458a-9c37-bfb75eb76beb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:47.507474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab57fd-6fb8-458a-9c37-bfb75eb76beb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:47.511105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 116/230] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:47.521209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:47.521735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:47.522112 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:47.552259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:47.554180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:47.653463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 115/231] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:47.696478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab57fd-6fb8-458a-9c37-bfb75eb76beb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:47.718023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab57fd-6fb8-458a-9c37-bfb75eb76beb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:47.725618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:47.727021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:47.727497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:47.727971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:47.729991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:47.733118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090afbbc-60e8-47ec-b5c2-797860c8e041 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:47.736482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 117/232] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:47.746161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:47.763761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c805b-1ad8-463d-987e-9fea484d7e56 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:47.771249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:47.772418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:47.772965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:47.773473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:47.774862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:47.777960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d18c47-273b-4c40-9395-a1e1f7684b90 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:47.811012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 116/233] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:47 2021] POST /identity/v3/users => generated 297 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:48.818608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092d64-3abe-4563-a600-f30c1ccdfff6 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:48.819137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092d64-3abe-4563-a600-f30c1ccdfff6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:48.819137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092d64-3abe-4563-a600-f30c1ccdfff6 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:48.821258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 118/234] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:48.827642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:48.828188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:48.828264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:48.847496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:48.848736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:48.856668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 117/235] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:48.906233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092d64-3abe-4563-a600-f30c1ccdfff6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:48.923031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092d64-3abe-4563-a600-f30c1ccdfff6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:48.927529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:48.928341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:48.928663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:48.928933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:48.946966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:48.954517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:48.956039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 119/236] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:48.962817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:48.973400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a99c9-dbf2-4b81-a437-01d95363b9b9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:48.977845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:48.978536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:48.978812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:48.979084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:48.979868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:48.980173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:48.981835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:48.992233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 118/237] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:48.998697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.014920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212176-d642-42c9-b1b0-53d0fe032f11 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.020133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.021090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.021369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.021707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] PATH_INFO: `/v3/users/26d376fd59a64c3899c71de47700f6f7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.022962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=26d376fd59a64c3899c71de47700f6f7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.025212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3033b-d0df-4025-bc55-a18c75e79cb6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.027129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 120/238] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:48 2021] GET /identity/v3/users/26d376fd59a64c3899c71de47700f6f7 => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.033621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.043945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044369-37da-4e11-957e-f9fb82e73088 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.053370 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.054277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.054568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.054846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.056169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.059849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9644-327d-4786-babb-dbfd381da666 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.060120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9644-327d-4786-babb-dbfd381da666 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.060388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9644-327d-4786-babb-dbfd381da666 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.062441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 121/239] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:49.062690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.064910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 119/240] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.072209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.072595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.072756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.080104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.098328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baaf1-eb2b-4506-bce8-a573447a39bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.103503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:49.104735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:49.111131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.112056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.112303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.112611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/26d376fd59a64c3899c71de47700f6f7/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.118418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, user_id=26d376fd59a64c3899c71de47700f6f7, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.121295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.127109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 122/241] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:49.151153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.160461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 120/242] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:49 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/26d376fd59a64c3899c71de47700f6f7/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:49.162989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a930e-0ba3-4502-b5a0-cc261fb28f77 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.243745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.244863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.245291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.245703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.260030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:49.267951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:07:49.269483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 123/243] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:49.276333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.288242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70156c-2739-43fa-8a4c-2b0d28132b5b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.300396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.301473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.301908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.302321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.303250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:49.303694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.305519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.316104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 121/244] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.322511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.334173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba6c2-6426-4c82-9beb-a05be83f7485 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.350461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.351437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.351718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.351989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.357562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.360167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.362413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 124/245] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.369073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.388695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5085-862a-4db2-94f1-da85683e7e13 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.395744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.396760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.397182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.397593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.412471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.414876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.432600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 122/246] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:49.433632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.459497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb08ab-5e93-46c7-95d9-f77d62e32d3f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.475646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.476685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.476967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.477242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.481572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.483872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5ca26-7ca7-4dfa-b489-2d13946851c0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.486387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 125/247] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.493248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.512472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c33ab-3d57-4a9c-8c44-4735ed50003d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.521364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.522311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.522732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.523142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.524253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=a3959e18da7745f8b9e59b7e3f837e3e) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:49.524759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.526846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbee412-1a70-46f6-9039-d34688dc8c7d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.539037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 123/248] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/role_assignments?user.id=a3959e18da7745f8b9e59b7e3f837e3e&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:49.754950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611af26-f225-4ebc-afd0-f8cf6296e655 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.755139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611af26-f225-4ebc-afd0-f8cf6296e655 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.755415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611af26-f225-4ebc-afd0-f8cf6296e655 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.757821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 126/249] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:49.767892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.768580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.769067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.798129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:49.799881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:49.811982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 124/250] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:49.890350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611af26-f225-4ebc-afd0-f8cf6296e655 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.904660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611af26-f225-4ebc-afd0-f8cf6296e655 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.912126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.913510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.914044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.914530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.928865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:49.936184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:07:49.937771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 127/251] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:49.947833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:49.962972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b1924-cf1f-4555-8d8f-9cc8aee9970b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:49.972006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:49.972722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:49.973020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:49.973275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:49.974061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:49.974369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:49.975985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:49.986234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 125/252] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:49.998780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.021556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a972-901e-4fa4-b2fa-53653f94861d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.035128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.036082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.036365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.036718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] PATH_INFO: `/v3/users/a3959e18da7745f8b9e59b7e3f837e3e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.038028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3959e18da7745f8b9e59b7e3f837e3e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:50.040291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:50.043604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 128/253] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:49 2021] GET /identity/v3/users/a3959e18da7745f8b9e59b7e3f837e3e => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:50.052396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.066457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836fd37-714b-4b36-8394-24c0cf2ae7da admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.073605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.074270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.074539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.074815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.084916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:50.086687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:50.100029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 126/254] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:50.110166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.124345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b050fb-6afc-4869-ba21-610674c23d45 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.130567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.131452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.131729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.132001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.133880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:50.136024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105b032-2f7c-42c8-8922-d5f00787ff6e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:50.137918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 129/255] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:50.148421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.165992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b7f5a-63bc-41ad-88ea-21a70e9db1a1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.170680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.171352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.171772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.172063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.173428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=a3959e18da7745f8b9e59b7e3f837e3e) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:50.173740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:50.175608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d087-cb50-4cba-844d-8a361c32747d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:50.182330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 127/256] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/role_assignments?user.id=a3959e18da7745f8b9e59b7e3f837e3e&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:50.823776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebfa33-eb72-4827-95b7-17e552ea1fe1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.824040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebfa33-eb72-4827-95b7-17e552ea1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.824403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebfa33-eb72-4827-95b7-17e552ea1fe1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.826436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 130/257] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:50.833291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.833630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.833860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.853721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:50.854908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:50.863548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 128/258] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:50.888318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebfa33-eb72-4827-95b7-17e552ea1fe1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.902806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebfa33-eb72-4827-95b7-17e552ea1fe1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.909017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.909832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.910108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.910390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.923167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:50.930183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:50.931673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 131/259] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:50.938490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.947968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d747b6-6fdc-4180-ace9-085654f2caaf None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:50.953428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:50.954635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:50.954970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:50.955304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:50.956154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:50.956557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:50.958268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:50.968210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 129/260] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:50.978046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:50.998318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f649-8009-4a1c-b8f2-c1c5d3f9529c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.009799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.011323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.011814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.012355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] PATH_INFO: `/v3/users/2f4ca33475e04a108db90c7564e8cb65` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.037262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f4ca33475e04a108db90c7564e8cb65)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.041565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.044776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 132/261] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:50 2021] GET /identity/v3/users/2f4ca33475e04a108db90c7564e8cb65 => generated 297 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:51.050940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:51.061152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc8ed-602e-477b-8ad9-e0920ef18921 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.065777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.066432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.066708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.066984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.075829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.077519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.088006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 130/262] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:51.095035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:51.112125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f38d1-ed68-4fd2-bf15-d021aaa75b37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.122068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.123599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.124147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.124666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.127294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.131403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93fc6-6f92-475f-81d6-a223d582703e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.134796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 133/263] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:51 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:51.141695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:51.151993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37666d7b-10be-40b6-977a-53078e556e93 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.157235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.157979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.158336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.158671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.159653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=2f4ca33475e04a108db90c7564e8cb65) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:51.160024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.161988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051157e-6c69-4e82-86a9-8b0a964595f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.168649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 131/264] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:51 2021] GET /identity/v3/role_assignments?user.id=2f4ca33475e04a108db90c7564e8cb65&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=6578e00baa8946f69479551803fdf4a5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:51.369368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651440-3a38-4ca3-b4e6-19fc9919fefb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.369825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651440-3a38-4ca3-b4e6-19fc9919fefb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.370151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651440-3a38-4ca3-b4e6-19fc9919fefb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.372522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 134/265] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:51.379621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.380043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.380497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.400450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:51.401864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:51.414883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 132/266] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:51.457097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651440-3a38-4ca3-b4e6-19fc9919fefb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:51.477936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651440-3a38-4ca3-b4e6-19fc9919fefb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.485595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.486908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.487381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.487855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.490351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.493399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2ee2e-7c69-4b39-8dd8-1b595549e589 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.496356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 135/267] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:51.506189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:51.522113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf33ad-0111-4b8f-8142-1dbf54d5c68c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:51.529381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:51.530507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:51.530984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:51.531485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:51.532829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:51.536424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af60716-2040-40f4-9b27-97e1197b18a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:51.565826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 133/268] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:51 2021] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:52.088696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498251c-b24e-4749-99e6-5bf19fc7d304 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.089225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498251c-b24e-4749-99e6-5bf19fc7d304 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.089225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498251c-b24e-4749-99e6-5bf19fc7d304 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.091271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 136/269] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:52.098487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.099417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.099885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.119555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:52.121162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:52.129868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 134/270] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:52.154796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498251c-b24e-4749-99e6-5bf19fc7d304 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.169859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498251c-b24e-4749-99e6-5bf19fc7d304 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.175268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.176406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.176911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.177383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.190693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:52.198159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:52.199635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 137/271] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:52.206768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.216933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbcee9-178d-4143-884e-3feef16494c7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.222295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.223236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.223732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.224192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.225260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:52.225757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:52.227585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:52.238209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 135/272] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:52.244484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.256057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a597d-bf48-4bc9-b077-755ae93b3319 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.261094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.262306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.262796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.263261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] PATH_INFO: `/v3/users/26d376fd59a64c3899c71de47700f6f7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.264707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] RBAC: Authorizing `identity:get_user(user_id=26d376fd59a64c3899c71de47700f6f7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:52.267662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:52.269658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 138/273] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/users/26d376fd59a64c3899c71de47700f6f7 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:52.275878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.287131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8c62-8f67-4fff-bb34-9279e639c0cd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.292117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.293092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.293583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.294113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.303684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:52.305822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:52.316671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 136/274] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:52.323108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.334453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a8d6-9d77-4377-a945-47442d7ea566 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.339609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.340821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.341301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.342129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.343635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:52.346404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c23ea-4496-4625-8015-cbaf3b04d7f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:52.348511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 139/275] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:52.355118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:52.365640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344946-82a4-4405-a4e7-a4a3dbe18c0b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:52.370667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:52.371593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:52.372156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:52.372661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:52.373717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=26d376fd59a64c3899c71de47700f6f7) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:52.374243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:52.376928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e825-6c19-4288-8f37-40f930ed258d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:52.384101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 137/276] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:52 2021] GET /identity/v3/role_assignments?user.id=26d376fd59a64c3899c71de47700f6f7&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:54.107641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d86-f6a0-4406-ad9e-9376199ceedc None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.108817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d86-f6a0-4406-ad9e-9376199ceedc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.108817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d86-f6a0-4406-ad9e-9376199ceedc None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.110741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 140/277] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:54.116852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.117611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.117611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.123932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf0ca-3b82-46bf-bada-ae84ddad8232 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.124252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf0ca-3b82-46bf-bada-ae84ddad8232 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.124531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf0ca-3b82-46bf-bada-ae84ddad8232 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.126622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 141/278] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:54.132973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.133384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.133532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.138133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:54.139357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:54.147685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 138/279] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:54.154021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:54.155284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:54.163851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 142/280] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:54.171682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.181668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00c84-6138-4447-a211-425c53ec0ebb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.186508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.187524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.188279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.188519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.190005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.201958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:54.206490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9b6a-cf31-4993-a5c0-5d5a2369e4d1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.209415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:54.210993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 139/281] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:54.214114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.215388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.216185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.216355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.217543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.219196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.222606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.226158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 143/282] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:54.229111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea4c57-94a6-44ae-b317-4fcf3989c3d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.233615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.234720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.235001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.235259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.235520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.236195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:54.236503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.238110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.249825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 140/283] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:54.252282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536fdd8-a494-4a8a-a6c5-c61c80143e16 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.257321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.260020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.261110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.261535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.261958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.263146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.264868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:54.264868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:07:54.264868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:07:54.267036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.268359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf787a-1ca3-43c9-b6a1-b56ec48840de admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.273756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.274656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.274930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.275198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] PATH_INFO: `/v3/users/5cfd8e2795444f42871a3a99cda18157` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.303839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] RBAC: Authorizing `identity:get_user(user_id=5cfd8e2795444f42871a3a99cda18157)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.308491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65706c-2384-495c-8058-c04a1d30ef2a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.309485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 144/284] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:07:54 2021] POST /identity/v3/users => generated 293 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:07:54.312858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 141/285] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/users/5cfd8e2795444f42871a3a99cda18157 => generated 293 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:54.320120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.333426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3dd89-4ec5-4edd-bd0b-78db43548946 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.338380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.339076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.339354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.339625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.340535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, user.id=5cfd8e2795444f42871a3a99cda18157, scope.system=all) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:54.340844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.343142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4410d7-7601-491f-b7c1-e47bfb1a00ae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.354243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 145/286] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/role_assignments?user.id=5cfd8e2795444f42871a3a99cda18157&scope.system=all&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:54.768099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e4ec-c568-4b16-aa52-d5fce5a50854 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.768631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e4ec-c568-4b16-aa52-d5fce5a50854 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.769027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e4ec-c568-4b16-aa52-d5fce5a50854 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.771452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 142/287] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:54.778010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.778387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.778611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.799303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:54.800575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:54.808688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 146/288] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:54.847858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e4ec-c568-4b16-aa52-d5fce5a50854 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.868468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e4ec-c568-4b16-aa52-d5fce5a50854 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.875305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.876642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.877124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.877595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.897449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:54.906705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:54.908250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 143/289] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:54.914424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.924057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4f75-fcfe-44ee-8cf3-72b36a8901b9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.928542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.929222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.929505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.929780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.930547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:54.930823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.932468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.942083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 147/290] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:54.948169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.958257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08c41-b343-4111-be49-77d1f955dde8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.962675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.963564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.963843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.964118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] PATH_INFO: `/v3/users/2f4ca33475e04a108db90c7564e8cb65` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.965389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] RBAC: Authorizing `identity:get_user(user_id=2f4ca33475e04a108db90c7564e8cb65)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.967860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.969606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 144/291] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/users/2f4ca33475e04a108db90c7564e8cb65 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:54.975860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:54.986504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64dbc-8a5d-4a2f-819c-533ab5121343 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:54.991168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:54.992126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:54.992543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:54.992804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:54.993990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:54.996166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd12b9-89b1-452d-9f21-145f66c18ba3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:54.998241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 148/292] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:54 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:55.007197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:55.016480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3f21a-e893-42b6-a994-9547c701ddcf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:55.020776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:55.021588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:55.021861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:55.022183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/2f4ca33475e04a108db90c7564e8cb65/roles/6578e00baa8946f69479551803fdf4a5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:55.024192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, user_id=2f4ca33475e04a108db90c7564e8cb65, role_id=6578e00baa8946f69479551803fdf4a5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:55.027003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e7f11-4c26-40d4-adcb-47aa4e8fe4cb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:55.042595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 145/293] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:07:55 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/users/2f4ca33475e04a108db90c7564e8cb65/roles/6578e00baa8946f69479551803fdf4a5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:56.996175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83a5a-9dda-48fd-8b92-945015391a47 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:56.996791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83a5a-9dda-48fd-8b92-945015391a47 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:56.997168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83a5a-9dda-48fd-8b92-945015391a47 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.000962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 149/294] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:56 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:57.007220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.008197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.008709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.038140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:57.040177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:57.157974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 146/295] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:07:57.185604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83a5a-9dda-48fd-8b92-945015391a47 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.208554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83a5a-9dda-48fd-8b92-945015391a47 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.216685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.218871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.219531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.220138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.222751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.226357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf49d-d7bf-462a-97ae-3958ef2739ae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.229994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 150/296] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:57.237223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.248009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ea27-b75f-486c-9d93-080df6dccda0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.253658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.254894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.255399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.255881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] PATH_INFO: `/v3/groups` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.256917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.258261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:57.258261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:57.258261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:57.259940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a66d9c-a8aa-4c27-890e-3c28c31d913c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.284649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 147/297] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:07:57 2021] POST /identity/v3/groups => generated 229 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:57.665065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e459-562d-4fc3-a7e4-b8e9b98b100b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.665353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e459-562d-4fc3-a7e4-b8e9b98b100b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.665706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e459-562d-4fc3-a7e4-b8e9b98b100b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.667824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 151/298] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:57.675346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da112-aa05-45fd-b964-cb1a7ee8dc01 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.675808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da112-aa05-45fd-b964-cb1a7ee8dc01 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.676105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da112-aa05-45fd-b964-cb1a7ee8dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.701318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c50da112-aa05-45fd-b964-cb1a7ee8dc01 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:57.703701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c50da112-aa05-45fd-b964-cb1a7ee8dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:57.715939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 148/299] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:57.741513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e459-562d-4fc3-a7e4-b8e9b98b100b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.755869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e459-562d-4fc3-a7e4-b8e9b98b100b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.761031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.761905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.762183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.762457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.776786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:57.777825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca174-f5d2-4bcc-a47c-ce42cce128a1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.778259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca174-f5d2-4bcc-a47c-ce42cce128a1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.778680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca174-f5d2-4bcc-a47c-ce42cce128a1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.782199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 149/300] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:07:57.784750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:57.786347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 152/301] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:07:57.791856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.792295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.792698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.792843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.813181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ce2b-e8c6-424a-a84b-296ee4f2ebe0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.817155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:57.818437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:57.820669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.822009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.822664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.823289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.824745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:57.825412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.826343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 150/302] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:57.829253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.846363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 153/303] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:57.854004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.859873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.865668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf581b-8214-4a00-9747-6bcd585470f2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.870373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.871501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.871788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.872063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] PATH_INFO: `/v3/users/2f4ca33475e04a108db90c7564e8cb65` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.873481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f4ca33475e04a108db90c7564e8cb65)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.876674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.878840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 151/304] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/users/2f4ca33475e04a108db90c7564e8cb65 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:57.879879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136c22-5f02-4ca7-9cee-92543e3a086f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.885133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.886989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.888535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.889193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.889803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.897489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ca59-91fb-420a-bf8c-432a2b2f2334 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.902374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.903045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.903327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.903599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.910469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:57.913435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.915401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2fd29-d2c8-4e51-a8b8-505ac4a1d045 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.922716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:07:57.924882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 154/305] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:57.925948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 152/306] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:57.928469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf006-2f62-4245-a42b-147e8e16c5c1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.929019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf006-2f62-4245-a42b-147e8e16c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.929541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf006-2f62-4245-a42b-147e8e16c5c1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.931589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 153/307] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:07:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:57.937712 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf006-2f62-4245-a42b-147e8e16c5c1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.938195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.951274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf006-2f62-4245-a42b-147e8e16c5c1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.953587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f9129-1383-469c-a048-d381e26d0e4d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.956234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.957038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.957319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.957581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.958361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:57.958667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.960288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7267-ecbd-4da7-829d-93712ed39fe7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.960394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.961721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.962172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.962615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.964718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:57.968829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:57.971203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 154/308] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:57.972416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.972689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.972960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.977357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 155/309] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:57.979410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:57.991456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72278-bae3-473d-8f86-dad321f0ec0a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:57.996537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:57.997415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:57.997696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:57.997967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] PATH_INFO: `/v3/users/5cfd8e2795444f42871a3a99cda18157` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:57.999480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] RBAC: Authorizing `identity:get_user(user_id=5cfd8e2795444f42871a3a99cda18157)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.002065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.008661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 156/310] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:57 2021] GET /identity/v3/users/5cfd8e2795444f42871a3a99cda18157 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:07:58.008661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.011167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:58.013141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:58.027769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24f4d2-fc1e-465f-8ea4-c6bb39a60a8f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.036684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 155/311] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:07:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:07:58.036684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.043432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.044642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.045169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.045691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.047243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, scope.project.id=a3442d85505546e6ae77e1f166db36f4, user.id=2f4ca33475e04a108db90c7564e8cb65) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:58.047842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.051329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.059778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 157/312] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:07:58 2021] GET /identity/v3/role_assignments?user.id=2f4ca33475e04a108db90c7564e8cb65&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=6578e00baa8946f69479551803fdf4a5 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:58.061298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61adec-b618-4c90-95ea-b7ec5bcdbaae None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.062496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.069192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.070752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.071245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.071738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] PATH_INFO: `/v3/system/users/5cfd8e2795444f42871a3a99cda18157/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.074785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5cfd8e2795444f42871a3a99cda18157, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.076775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:58.076775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:07:58.076775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:07:58.077208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75fa23-9295-445e-a1bf-fbcce28aed0c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.078459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.084681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.085973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.086298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.086652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.098522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 156/313] 10.222.0.30 () {58 vars in 1355 bytes} [Wed Dec 15 16:07:58 2021] PUT /identity/v3/system/users/5cfd8e2795444f42871a3a99cda18157/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:58.111834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:07:58.127775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:07:58.130165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 158/314] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:07:58 2021] GET /identity/v3/roles/reader => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:07:58.137400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.149352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984e74-47a1-464e-807d-9d7391db3178 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.154751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.155883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.156558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.157290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.158291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:58.158674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.160707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.172417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 157/315] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:07:58 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:58.183315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.202535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b812e-b7c9-4538-9588-f572dfdc7d24 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.211085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.212840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.213347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.213831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] PATH_INFO: `/v3/users/ffa1cf71251f49b08dd8b96d9e842771` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.245116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffa1cf71251f49b08dd8b96d9e842771)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.249689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c173e-5bbd-4aca-a9d9-4694becbedd7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.253759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 159/316] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:07:58 2021] GET /identity/v3/users/ffa1cf71251f49b08dd8b96d9e842771 => generated 293 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:58.261189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:58.280247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb91e-f578-4d6a-ab84-8ff87b9e93ce admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:58.289012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:58.290295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:58.290869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:58.291436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:58.293366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, user.id=ffa1cf71251f49b08dd8b96d9e842771, scope.system=all) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:58.294014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:58.298691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8dd4a-9824-4555-9b86-03bcd87cf095 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:58.315038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 158/317] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Dec 15 16:07:58 2021] GET /identity/v3/role_assignments?user.id=ffa1cf71251f49b08dd8b96d9e842771&scope.system=all&role.id=6578e00baa8946f69479551803fdf4a5 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:00.584293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959bb7-1763-4e86-9060-af91de40af5c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:00.584923 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959bb7-1763-4e86-9060-af91de40af5c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:00.585213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959bb7-1763-4e86-9060-af91de40af5c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:00.588510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 160/318] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:00.595868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:00.596652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:00.596652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:00.617757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:00.619050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:00.627848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 159/319] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:00.651612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959bb7-1763-4e86-9060-af91de40af5c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:00.665484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959bb7-1763-4e86-9060-af91de40af5c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:00.670092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:00.670917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:00.671192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:00.671462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:00.673282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:00.675075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e661-b387-43f8-af32-7f4b2cfc9544 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:00.677150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 161/320] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:00.683289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:00.693693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e497a-dfe4-4ff4-9efb-3a590f107265 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:00.698500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:00.699202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:00.699482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:00.699756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] PATH_INFO: `/v3/groups` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:00.700562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:00.702647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562869f8-b309-44eb-a698-a28e5eaa17a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:00.721429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 160/321] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:08:00 2021] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:01.390661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5665b-5f66-406d-97f4-386eafdcb26c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.391674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5665b-5f66-406d-97f4-386eafdcb26c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.391674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5665b-5f66-406d-97f4-386eafdcb26c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.393571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 162/322] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:01.400145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.400843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.401339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.428693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:01.430283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:01.450228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 161/323] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 16:08:01.478069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5665b-5f66-406d-97f4-386eafdcb26c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:01.493359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5665b-5f66-406d-97f4-386eafdcb26c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:01.501438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:01.502650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.503128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.503597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.517553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:01.526855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:01.532661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 163/324] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:01.536623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:01.557805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f68e02-9029-4854-98d6-c49b23b4735d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:01.565335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:01.566570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.567055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.567528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.568915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:01.569455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:01.575415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:01.595496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 162/325] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:01.601926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:01.626193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28c484-4bdb-4fc7-8351-1d96b496cf05 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:01.636627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:01.638252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.638751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.639230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] PATH_INFO: `/v3/users/5cfd8e2795444f42871a3a99cda18157` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.643112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] RBAC: Authorizing `identity:get_user(user_id=5cfd8e2795444f42871a3a99cda18157)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:01.647295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44225-d146-404e-a108-58cb54dea75b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:01.650804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 164/326] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:08:01 2021] GET /identity/v3/users/5cfd8e2795444f42871a3a99cda18157 => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:01.657926 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:01.675842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24657a5-ea72-4a0d-99e0-b25d2309b7e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:01.687775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:01.688494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.688873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.689146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.690010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] RBAC: Adding query filter params (role.id=2cf8ebee4de04d798d9be9a723dbd015, user.id=5cfd8e2795444f42871a3a99cda18157, scope.system=all) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:01.690313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:01.692188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38263cf0-6fa9-41c1-951d-9390549cc073 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:01.717335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 163/327] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Dec 15 16:08:01 2021] GET /identity/v3/role_assignments?user.id=5cfd8e2795444f42871a3a99cda18157&scope.system=all&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 510 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:01.809236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba8b4-afac-41f2-a421-a58e6445b581 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.809713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba8b4-afac-41f2-a421-a58e6445b581 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.810190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba8b4-afac-41f2-a421-a58e6445b581 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.816386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 165/328] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:01 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:01.827643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.828680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.828680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:01.852665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:01.853874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:01.864238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 164/329] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:01.942460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ba8b4-afac-41f2-a421-a58e6445b581 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:01.970741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ba8b4-afac-41f2-a421-a58e6445b581 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:01.979257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:01.980620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:01.981102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:01.981636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:02.007487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:02.025241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:08:02.027947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 166/330] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:01 2021] GET /identity/v3/roles/reader => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:02.039127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:02.054504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5da5-af4c-4ba5-832f-15cc92f8eca7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:02.069252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:02.069955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:02.070229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:02.070506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:02.071291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:02.071598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:02.073274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:02.083690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 165/331] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:02 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:02.094575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:02.117980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4657-0d82-4050-ba02-931feb78e0a2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:02.130799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:02.132323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:02.132898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:02.133370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] PATH_INFO: `/v3/users/ffa1cf71251f49b08dd8b96d9e842771` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:02.142222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffa1cf71251f49b08dd8b96d9e842771)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:02.146525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58678eb-b6e6-453b-a346-62e0417ea964 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:02.149925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 167/332] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:08:02 2021] GET /identity/v3/users/ffa1cf71251f49b08dd8b96d9e842771 => generated 293 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:02.160285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:02.174404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e97c0-289f-4bcf-84b3-89948514a925 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:02.185215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:02.186481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:02.186941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:02.187432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] PATH_INFO: `/v3/system/users/ffa1cf71251f49b08dd8b96d9e842771/roles/6578e00baa8946f69479551803fdf4a5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:02.189570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ffa1cf71251f49b08dd8b96d9e842771, role_id=6578e00baa8946f69479551803fdf4a5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:02.191516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4fe0-6fe7-40fd-adf7-e334dc543b74 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:02.209370 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 166/333] 10.222.0.30 () {58 vars in 1355 bytes} [Wed Dec 15 16:08:02 2021] PUT /identity/v3/system/users/ffa1cf71251f49b08dd8b96d9e842771/roles/6578e00baa8946f69479551803fdf4a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:04.867866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f3eb-835d-489c-83fc-64c3df849fd9 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:04.869222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f3eb-835d-489c-83fc-64c3df849fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:04.869906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f3eb-835d-489c-83fc-64c3df849fd9 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:04.873837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 168/334] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:04 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:04.883530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:04.884951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:04.885905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:04.924494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:04.926867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:04.944280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 167/335] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:05.001850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f3eb-835d-489c-83fc-64c3df849fd9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.030653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f3eb-835d-489c-83fc-64c3df849fd9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.041653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.043567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.044326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.045104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.070745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:05.088104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:05.091151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 169/336] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:05.101976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.132787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a884744-c979-4409-8866-59d4c144b1eb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.151186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.152634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.152839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.153534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.155143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:05.155880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.159291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.189084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 168/337] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:05.199208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.221295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8cd16-f873-4bc2-a12b-d61b8c60e1a3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.234252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.235285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.235697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.236106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.253994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.257180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.277022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 170/338] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:05.287802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.318973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599d1d-20b9-4305-bdd0-0d7a1d671746 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.334704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.336203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.336697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.337170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.339196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.343431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.347156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 169/339] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:05.356969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.382118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c00a18-0e87-48ae-9b4e-e40979bd5ad5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.398790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.400665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.401433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.402163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.415798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.418130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:05.418130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:05.418130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:05.421005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d82d4-90bc-491d-87c4-68a34be4a82f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.424485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 171/340] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:05.435361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.464386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ae3d9-45c7-4ada-8bd0-6d9d30d07d52 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.474646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.475800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.476311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.476847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.478530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=4cd7b955df6e4eb192e35637959278aa) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:05.479106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.482725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d2f3-1903-40c6-b683-544d12b2c9df admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.501141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 170/341] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 260 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:05.631997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28c71-0dad-4636-b323-9f23526d35e0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.633055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28c71-0dad-4636-b323-9f23526d35e0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.633792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28c71-0dad-4636-b323-9f23526d35e0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.642570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 172/342] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:05 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:05.663034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e74a-1439-4263-ae78-263f516f2d95 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.663542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e74a-1439-4263-ae78-263f516f2d95 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.664043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e74a-1439-4263-ae78-263f516f2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.709814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b351e74a-1439-4263-ae78-263f516f2d95 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:05.711052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b351e74a-1439-4263-ae78-263f516f2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:05.720185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 171/343] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:05.806114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28c71-0dad-4636-b323-9f23526d35e0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.834898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28c71-0dad-4636-b323-9f23526d35e0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.835971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfc8d-9202-4de7-a93a-32c8145de96a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.836612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfc8d-9202-4de7-a93a-32c8145de96a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.837088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfc8d-9202-4de7-a93a-32c8145de96a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.839392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 172/344] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:05.845071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.846762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.847480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.847644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.848107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.848297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.849027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.869994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:05.884578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:05.888717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 173/345] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:05.894596 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:05.904583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:05.924082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 173/346] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:05.926966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.946621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b421-e312-4eb2-a9f3-1dc163ba36be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:05.955976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:05.956860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:05.957158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:05.957401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:05.958173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:05.958476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:05.960096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:05.966596 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.980529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 174/347] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:05.990007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:05.993478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bef9a-cf73-45ad-b691-a6aff6df3538 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.008389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d543f9-f133-442f-9cae-dcb301f5faef admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.010894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.012837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.013696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.014451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.033010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.034619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.036703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.037497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.058038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:06.058684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.061977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.078039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:06.081348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 174/348] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:06.084468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 175/349] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:06.096794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.114082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.130331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955a9bf-703c-42af-89ad-b949c8c56397 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.139760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4a31-1b5d-482b-aa37-f629e81d951e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.148256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.150872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.152091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.152862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.154147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.156824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.157297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:06.158004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.158750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.160902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.165330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.166362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.174241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.181630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 176/350] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:06.190567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 175/351] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:06.204209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.207233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.225492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac297e-ec9c-4b6c-bcb1-cef1c51406bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.226935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f773-fcf4-42a9-a32d-9788404b2b47 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.238895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.240403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.242402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.243966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.245079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.245667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.246373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.247140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.251291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.255881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.265247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 177/352] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:06.278495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.288969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.292360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.309024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee4ab-314f-4e28-8289-aa06ca2c6ee5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.321100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 176/353] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:06.329748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.331344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.332051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.332293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.333065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.334863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=a3442d85505546e6ae77e1f166db36f4) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:06.335836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.339722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.350101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbd66-493f-4efc-8787-344d9771e5f7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.355124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 178/354] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 260 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:06.366856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.368549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.369054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.369625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.374279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.378568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.385107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 177/355] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:06.403290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.425562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a510e4-1573-4512-b3f3-a4ef494a49cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.437161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.439209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.439991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.440798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.443281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.447183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41cabf-ac82-4280-99da-5d19e60eee26 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.450793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 179/356] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:06.462077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:06.487706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cae7-aee4-4515-ad55-7b8b4f012197 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:06.502496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:06.503725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:06.504289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:06.504820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:06.506592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=4cd7b955df6e4eb192e35637959278aa) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:06.507237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:06.511245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32de27d-26de-44d8-8708-a7bdaa966175 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:06.532851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 178/357] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:06 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 260 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.167560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c6a-065b-4e16-947c-0a569fba96e4 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.168975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c6a-065b-4e16-947c-0a569fba96e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.169656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c6a-065b-4e16-947c-0a569fba96e4 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.173452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 180/358] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:07 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:07.183699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.184471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.184601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.224954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:07.226834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:07.247282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 179/359] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:07.327922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07c6a-065b-4e16-947c-0a569fba96e4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.354620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07c6a-065b-4e16-947c-0a569fba96e4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.367249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.368686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.369178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.369661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.399294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:07.418218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-83a44b32-fbde-408e-bc9d-a9c3b6725b92 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:07.425077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 181/360] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:07.431950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.451726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde73b-96f9-4bff-9f41-d1ae3b456290 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.452148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde73b-96f9-4bff-9f41-d1ae3b456290 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.452707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde73b-96f9-4bff-9f41-d1ae3b456290 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.461731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62918251-1496-4e0f-82eb-0439ae3a6b19 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.463049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 182/361] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:07 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:07.471341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.471785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.472254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.472953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.474233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.474880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.475430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.476958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:07.477486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.480639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.508945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 180/362] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.515123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:07.521510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:07.533586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.541103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 183/363] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:07.549353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c2bb-372a-4789-951d-efb54e9bd17f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.560178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.560942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.561209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.561481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.572119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.574156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.577157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.595747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c4ee-61c2-4fd6-b7ce-dea8770abe21 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.599122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 181/364] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:07.609883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.611194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.611658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.612124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.640902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.641732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:07.651581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb7552-2af7-4159-b48a-4a0c74c0b945 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.659393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 16:08:07.662147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 184/365] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/roles/reader => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:07.668205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.669633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.670083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.670545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.673397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.675997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.680027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.698015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 182/366] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.711837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708edbc1-d477-4444-a599-bb96b48c9668 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.721762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.734273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.738481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.738881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.739454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.740846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:07.742298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.744379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.755872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50d1d4-401e-4e6c-a3ea-24005fa6c90c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.764936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 185/367] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.773173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.773808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.774716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.774980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.775253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.777070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.778137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:07.778137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:07.778137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:07.779362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.781344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 183/368] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.791689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.792829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7a88-8b43-4b12-ac5c-447faafffa85 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.806513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59f0c-2813-4311-b9a2-ea686d339bf6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.809022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.809931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.810193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.810465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] PATH_INFO: `/v3/users/ffa1cf71251f49b08dd8b96d9e842771` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.812151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffa1cf71251f49b08dd8b96d9e842771)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.814560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.816327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 186/369] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/users/ffa1cf71251f49b08dd8b96d9e842771 => generated 293 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.824677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.825362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.825662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.825905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.826773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=a3442d85505546e6ae77e1f166db36f4) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:07.827085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.829444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90112c6-7fe9-44a6-92d9-fa4d149929fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.833950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:07.846859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a67e-5cc3-4e33-86ba-fa853e59ccf8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:07.850291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 184/370] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 260 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:07.860152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:07.860870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:07.861150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:07.861429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:07.862327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] RBAC: Adding query filter params (role.id=6578e00baa8946f69479551803fdf4a5, user.id=ffa1cf71251f49b08dd8b96d9e842771, scope.system=all) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:07.862639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:07.869336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f700772-c94d-4095-ae56-27bcea193fb9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:07.888193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 187/371] 10.222.0.30 () {56 vars in 1329 bytes} [Wed Dec 15 16:08:07 2021] GET /identity/v3/role_assignments?user.id=ffa1cf71251f49b08dd8b96d9e842771&scope.system=all&role.id=6578e00baa8946f69479551803fdf4a5 => generated 510 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:08.787306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c755-a23e-4810-9dea-0f8867e42c11 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:08.788394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c755-a23e-4810-9dea-0f8867e42c11 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:08.788394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c755-a23e-4810-9dea-0f8867e42c11 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:08.790039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 185/372] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:08.796151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:08.797284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:08.797284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:08.825639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:08.826868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:08.835958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 188/373] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:08.881143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c755-a23e-4810-9dea-0f8867e42c11 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:08.896299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c755-a23e-4810-9dea-0f8867e42c11 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:08.900905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:08.901707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:08.901990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:08.902258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:08.917351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:08.925233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:08.926858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 186/374] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:08.932933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:08.943250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5f66-1870-426f-9fe5-b91eb6f9e6b5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:08.952931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:08.954492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:08.954764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:08.955027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:08.955808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:08.956114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:08.957956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:08.967922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 189/375] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:08.974031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:08.990666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272efb-a5a6-4d34-9a18-61e4746e1cf2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:08.995386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:08.996047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:08.996336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:08.996654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:09.016475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:09.016475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:09.026875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 187/376] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:09.033461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:09.049368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dad0-a2da-4385-9496-d825596d95c8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:09.053955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:09.054841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:09.055118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:09.055373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] PATH_INFO: `/v3/projects/8a6b08d818d54c3e97808ca092a07d94` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:09.056895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a6b08d818d54c3e97808ca092a07d94)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:09.058732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:09.060712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 190/377] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:09 2021] GET /identity/v3/projects/8a6b08d818d54c3e97808ca092a07d94 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:09.067491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:09.077842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb7bb-d12a-4588-bc1f-12a505359f5c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:09.089460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:09.090351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:09.090613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:09.090886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] PATH_INFO: `/v3/groups/028fda7c9065431890294f421137625f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:09.106249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] RBAC: Authorizing `identity:get_group(group_id=028fda7c9065431890294f421137625f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:09.108238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92991e26-9de1-41f3-8744-7a2915e40966 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:09.111461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 188/378] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:09 2021] GET /identity/v3/groups/028fda7c9065431890294f421137625f => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:09.122542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:09.131204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235fc62-61cd-4a06-a575-7501b9ca14f8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:09.150668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:09.151341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:09.151628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:09.151903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:09.152784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] RBAC: Adding query filter params (group.id=028fda7c9065431890294f421137625f, role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=8a6b08d818d54c3e97808ca092a07d94) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:09.153097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:09.155001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e77e9-1fc5-477f-99fc-2e282560cc18 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:09.168544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 191/379] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:09 2021] GET /identity/v3/role_assignments?group.id=028fda7c9065431890294f421137625f&scope.project.id=8a6b08d818d54c3e97808ca092a07d94&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:10.750139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3cad-457b-48e1-9640-3b1a5295aa44 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.750790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3cad-457b-48e1-9640-3b1a5295aa44 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.750790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3cad-457b-48e1-9640-3b1a5295aa44 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.753112 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 189/380] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:10.756629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcfbad-5ce3-490b-b116-a16d7290e1e5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.757097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcfbad-5ce3-490b-b116-a16d7290e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.757197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcfbad-5ce3-490b-b116-a16d7290e1e5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.758970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 192/381] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:10.764037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.764666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.765149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.769548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.770194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.770674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.798409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:10.800077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:10.809222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:10.809802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 193/382] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:10.811064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:10.840496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 190/383] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:10.868043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:10.878778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcddc8-95b1-4b26-a09b-9e4161582f4d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:10.888406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:10.889628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.890120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.890744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.902646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:10.914681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:10.922864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441b76-572c-417b-adc6-8ee706e43011 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:10.926040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:10.927635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 194/384] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:10.936201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:10.936624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:10.937906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.938639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.939143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.949299 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886251e-b094-4257-a2ea-96f9f40fa5fd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:10.955515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:10.956214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:10.956677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:10.957150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:10.958117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:10.958580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:10.960108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:10.961018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:10.968115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:10.975344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 195/385] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:10.976894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 191/386] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:10.981899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:10.993827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7d397-32e4-43a5-866c-c3652b67894e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:10.998700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:10.999825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.003918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.014405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334323bb-39b7-47d8-84b5-db84c6a9a921 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.015072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.015547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.019109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.022160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.026468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 196/387] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:10 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.027344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.028199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.028663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.029087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.030009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:11.030451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.033042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.036584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.051041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25f448-f32c-4084-9365-5cc9fb323df5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.053756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 192/388] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.060638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.075957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5068-7dc3-42b4-9f90-fb65927460bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.077995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.080351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.081724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.082716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.085070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.086472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.088829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.089955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.090438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.090918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.095515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.097716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33408-e905-4dbd-a7f1-8238fd63341e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.098203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 197/389] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.105583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.106748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 193/390] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.117413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c136-4174-4c71-97da-41d4e0c56419 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.121617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56bc8-618f-4b24-9d3f-ce98c148c0cd None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.122314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56bc8-618f-4b24-9d3f-ce98c148c0cd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.122849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56bc8-618f-4b24-9d3f-ce98c148c0cd None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.127689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 194/391] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:11.128791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce56bc8-618f-4b24-9d3f-ce98c148c0cd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.129474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.130380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.130652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.130926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.135870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, group_id=1c8d6b06686b4c2b863a45ecaccb8285, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.141650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada291-0064-4ad5-9349-3ba1e758f527 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.150215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce56bc8-618f-4b24-9d3f-ce98c148c0cd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.157470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.159745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.160359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.161203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.163234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.168771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 198/392] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Dec 15 16:08:11 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:11.170172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a18c-d569-484b-b7ab-778e6c301855 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.170461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a18c-d569-484b-b7ab-778e6c301855 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.170739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a18c-d569-484b-b7ab-778e6c301855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.171347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.175698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 195/393] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.183015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.199662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3329a18c-d569-484b-b7ab-778e6c301855 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:11.201087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3329a18c-d569-484b-b7ab-778e6c301855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:11.223991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7a6d-c968-45e7-8c94-9b0bc6122e7e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.339727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 199/394] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:11.341547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac5ff-dde9-4710-a832-6353bb68623d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.341831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac5ff-dde9-4710-a832-6353bb68623d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.342099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac5ff-dde9-4710-a832-6353bb68623d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.348588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 200/395] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:11.351473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.351815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.352092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.352908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.353818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.354097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.354375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.359206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd7b955df6e4eb192e35637959278aa, group_id=1c8d6b06686b4c2b863a45ecaccb8285, role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.362687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.373105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:11.374429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:11.385071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 196/396] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Dec 15 16:08:11 2021] PUT /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:08:11.389920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.391323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 201/397] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:11.415807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.428130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68c233-19e9-4b33-91f8-c80729a98ba9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.500587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.501539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.501870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.502247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.514947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:11.520896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf35eae-083f-4c0f-a6d5-0dd48157edc0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.523174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:11.528696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 202/398] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:11.533287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.537265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.541056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.541056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.541056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.550352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c47e5-22ef-4ec0-ae91-053b7969ac32 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.563435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.564631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.565256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.565752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.567694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:11.568482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.568820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:11.573888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.585469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:11.588271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 197/399] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:11.592537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 203/400] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.599968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.601841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.614058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a3c2-04f1-4f00-9fe4-db709cad3886 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.619762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538174d8-6b0c-40e5-95c7-732821b1f970 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.620063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.620712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.621003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.621257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.622780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.625165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.632659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 204/401] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.634046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.635890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.637976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.638759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.639517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.641370 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:11.642433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.646889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ace2a-9a46-4349-af72-8ee5fd424b26 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.647149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.654835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.655748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.656024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.656561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.658133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.663322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.667757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 205/402] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.669280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 198/403] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.672474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.680611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce4632-86b6-4e69-94a6-f27f4ff19c04 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.683966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.685569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.686477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.686755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.687032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.693550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, group_id=1c8d6b06686b4c2b863a45ecaccb8285, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.696071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8ef4-1816-4a19-901a-f54368596726 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.696231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.706113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.708770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.709222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.709671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.713942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.717546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.721354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 199/404] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.733623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.734774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 206/405] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Dec 15 16:08:11 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:08:11.749213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872619-262f-44f5-8937-8e19fcfb1286 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.831008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.833049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.833579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.834074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.835750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.838260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46efa05-5407-489d-8fb2-635ca0d1ad46 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.844186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 200/406] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:11 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:11.851420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:11.863770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741b60f-652a-4e44-bf9f-0162dabad4c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:11.872474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:11.873894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:11.874452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:11.874979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:11.878980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3442d85505546e6ae77e1f166db36f4, group_id=1c8d6b06686b4c2b863a45ecaccb8285, role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:11.882324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cbb65-973c-4546-ab57-94f0ad70b2f4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:11.902519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 207/407] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Dec 15 16:08:11 2021] PUT /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4/groups/1c8d6b06686b4c2b863a45ecaccb8285/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:13.033651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5a1e-e7f3-4d26-abff-92cc47230d39 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.035205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5a1e-e7f3-4d26-abff-92cc47230d39 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.036008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5a1e-e7f3-4d26-abff-92cc47230d39 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.041413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 201/408] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:13 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:13.049359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.050112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.050112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.078406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:13.080505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:13.160193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 208/409] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:13.188254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5a1e-e7f3-4d26-abff-92cc47230d39 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:13.223226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5a1e-e7f3-4d26-abff-92cc47230d39 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:13.235245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:13.237094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.237881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.238604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.263445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:13.281291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:13.284359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 202/410] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:13.290257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:13.308071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9be0-1ad0-4b58-8ac8-9c928a21ed64 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:13.322048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:13.322751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.323030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.323304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.324078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:13.324379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:13.326066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:13.340932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 209/411] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:13.348800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:13.373406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46e4-cb68-4ac2-b9ec-527e17ad4d7e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:13.385261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:13.387358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.388139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.388901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] PATH_INFO: `/v3/groups/028fda7c9065431890294f421137625f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.391502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=028fda7c9065431890294f421137625f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:13.395428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:13.404089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 203/412] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:13 2021] GET /identity/v3/groups/028fda7c9065431890294f421137625f => generated 229 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:13.409814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:13.431964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2e1c2-f3ce-4e43-83ba-3a6c21993773 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:13.446450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:13.447362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.447646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.447918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] PATH_INFO: `/v3/projects/8a6b08d818d54c3e97808ca092a07d94` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.453922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] RBAC: Authorizing `identity:get_project(project_id=8a6b08d818d54c3e97808ca092a07d94)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:13.455854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3613f-34ca-4fde-9739-d905018e093a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:13.458146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 210/413] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:13 2021] GET /identity/v3/projects/8a6b08d818d54c3e97808ca092a07d94 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:13.465346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:13.488516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153d4a-7e78-4177-a2f0-9673205e98a1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:13.500629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:13.502931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:13.503810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:13.504593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] PATH_INFO: `/v3/projects/8a6b08d818d54c3e97808ca092a07d94/groups/028fda7c9065431890294f421137625f/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:13.508940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6b08d818d54c3e97808ca092a07d94, group_id=028fda7c9065431890294f421137625f, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:13.521801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74765f-42e2-4cff-bee4-7f18f9482beb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:13.552052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 204/414] 10.222.0.30 () {58 vars in 1463 bytes} [Wed Dec 15 16:08:13 2021] PUT /identity/v3/projects/8a6b08d818d54c3e97808ca092a07d94/groups/028fda7c9065431890294f421137625f/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:15.183353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8a41-5497-4791-8786-632c65d9bd8a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.184116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8a41-5497-4791-8786-632c65d9bd8a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.184116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8a41-5497-4791-8786-632c65d9bd8a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.186023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 211/415] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:15.195911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.196866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.196866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.198926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1dd33-adf5-4d14-8ae9-e4a0f1777469 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.199203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1dd33-adf5-4d14-8ae9-e4a0f1777469 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.199450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1dd33-adf5-4d14-8ae9-e4a0f1777469 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.201570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 212/416] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:15.208673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.208673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.209335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.225495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:15.226709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:15.228344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:15.229569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:15.292952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 213/417] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:15.318773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.328676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9b92-d6dc-4976-af31-c64a6623ed5c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.334900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.335720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.335989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.336270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.357136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:15.366049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:15.367617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 214/418] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:15.374595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.386056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e237-6756-438d-82f5-834f87248523 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.392180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.392891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.393194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.393445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.394205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:15.394511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.396148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.403441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 205/419] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:15.411610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 215/420] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.417650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.427904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299955-74a8-40aa-9c96-1a7ae1ea7a55 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.432605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.433263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.433532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.433868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.443163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.444976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.453764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.463848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4594e-69a9-4ea4-aca3-ae0b5728ee73 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.468932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 206/421] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:15.476039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.486119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.486954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.487217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.487493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.490675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae936-bba7-488e-b701-9f0dab5da3c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.505890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:15.513239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:15.514276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.514571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 216/422] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:15.515219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.515582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.515872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.517453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.519540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.521239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.528689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 207/423] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.531474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6aab-9645-443e-ae65-9fbf93b68e25 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.539388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.543332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.544270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.544810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.545302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.546268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:15.547286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.549512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.561254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 217/424] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:15.566708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebc76-901a-46cf-8dbd-aba6f435f6d2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.568688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.584977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.586305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.586816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.587290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.589137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.593369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65310f0-8647-4e64-850f-61e37aac65f2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.594794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072c00-701d-499d-852e-b27f5a396637 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.597381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 208/425] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.604369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.604805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2808f-5b43-4020-a520-3da0d645e04a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.605132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.605456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.605732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.605941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2808f-5b43-4020-a520-3da0d645e04a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.606410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2808f-5b43-4020-a520-3da0d645e04a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.608951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 209/426] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:15.610474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2808f-5b43-4020-a520-3da0d645e04a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.619396 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.621311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e59e-7542-441a-beab-f20f6796bc15 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.630731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2808f-5b43-4020-a520-3da0d645e04a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.636463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 218/427] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:15.636463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.636463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.636463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.647696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.648820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.649909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.650465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.651999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=4cd7b955df6e4eb192e35637959278aa) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:15.652570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.654880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.655304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:15.656829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:15.664265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 210/428] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 611 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.669684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.677233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 219/429] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:15.690256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85394-c687-4bbb-8042-53e4645dc91f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.697232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.698141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.698407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.698680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.705521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.707657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.709554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 211/430] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.719880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.730074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.738927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2cd4-95ac-4a34-bba6-7debba3c0b9f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.746258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.747188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.747699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.748582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.752184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.753977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5787f8-db05-4674-9490-9f27bcf6b366 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.756187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.759583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 220/431] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:15.771682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.771874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.772597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.772985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.773269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.788850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e752e-d1c5-432e-ac4f-27d31606fc93 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.798115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.799144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.799584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.800040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.801561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:15.813976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=a3442d85505546e6ae77e1f166db36f4) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:15.814522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.818331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fee96d-9e4b-4350-a7ce-45afe20a837d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.825979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:15.831755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 212/432] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:15.836751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.846397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 221/433] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 611 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.869221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77137d8f-58f8-4bed-b2c2-10323527a231 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.877321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.878587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.879092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.879589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.881257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:15.881735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.885104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:15.901276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c510d6-4afe-4497-bde4-ef7ae3c13ec7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.901623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c510d6-4afe-4497-bde4-ef7ae3c13ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.901823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c510d6-4afe-4497-bde4-ef7ae3c13ec7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.904389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 213/434] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:15.904851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 222/435] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:15.916662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:15.917094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.917446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.917732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.936573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac70d5c-42e4-45d2-9218-fa42229d4566 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:15.950006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:15.951441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:15.953859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:15.955142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:15.955720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:15.956284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:15.983831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 223/436] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:15.986042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:15.989296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.009698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 214/437] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:16.013389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.022967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.031137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98708766-8e74-4cc6-85f7-0fe2d187d6a0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.039750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.041047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.041584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.042008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.043702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.044308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4dff-9820-44d3-bd0d-2a6f860bca45 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.046370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.049407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 224/438] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:16.054257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.055639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.056320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.057006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.057823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.070211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae0b7-9e26-44a0-a945-068d6d0bcb8c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.075685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.076933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.077457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.077919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.078323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:16.079856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.082376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.085134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 225/439] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:16.092141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 16:08:16.092937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.095882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 215/440] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:16.104812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ff0-73ae-4950-91af-1e7138e1ce79 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.107467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.110619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.111550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.112083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.112535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.113662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=4cd7b955df6e4eb192e35637959278aa) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:16.114216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.116692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.126104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 226/441] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=4cd7b955df6e4eb192e35637959278aa&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:16.132589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc34fd-4c1a-4bab-9c2f-c97b2fd73b4b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.135869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.137329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.137953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.138567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.140186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:16.140952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.144518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.167802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 216/442] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:16.189734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.212393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7289-35f5-4b11-8613-1f1446b47122 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.220830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.221975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.222465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.222977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.238566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.242110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.262628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 227/443] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:16.272653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.291083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c638-761a-4111-b907-7927c0d38096 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.299213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.300899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.301392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.301891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] PATH_INFO: `/v3/projects/a3442d85505546e6ae77e1f166db36f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.304353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3442d85505546e6ae77e1f166db36f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.308520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.312080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 217/444] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/projects/a3442d85505546e6ae77e1f166db36f4 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:16.322181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.332533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bcee-e46c-4bd2-bde7-bb16ff335d27 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.337771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.339032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.339494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.339948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] PATH_INFO: `/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.341608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] RBAC: Authorizing `identity:get_group(group_id=1c8d6b06686b4c2b863a45ecaccb8285)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.344305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3973d-4df4-44e6-af8e-48049b08b168 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.346315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 228/445] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/groups/1c8d6b06686b4c2b863a45ecaccb8285 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:16.358141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:16.375473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776e348-a44f-42b8-852d-767081008144 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:16.383586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:16.384643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:16.385100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:16.385577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:16.387229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] RBAC: Adding query filter params (group.id=1c8d6b06686b4c2b863a45ecaccb8285, role.id=2cf8ebee4de04d798d9be9a723dbd015, scope.project.id=a3442d85505546e6ae77e1f166db36f4) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:16.387797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:16.392157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e944-e6fe-4122-b44c-c70f5d57cc9e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:16.401627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 218/446] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:16 2021] GET /identity/v3/role_assignments?group.id=1c8d6b06686b4c2b863a45ecaccb8285&scope.project.id=a3442d85505546e6ae77e1f166db36f4&role.id=2cf8ebee4de04d798d9be9a723dbd015 => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:17.458246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796191-dc95-44b7-a6f4-efd61c8bc0fa None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.458789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796191-dc95-44b7-a6f4-efd61c8bc0fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.458789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796191-dc95-44b7-a6f4-efd61c8bc0fa None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.460692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 229/447] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:17.467273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.468127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.468127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.489323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:17.490544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:17.501026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 219/448] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:17.524944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff796191-dc95-44b7-a6f4-efd61c8bc0fa None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.539460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff796191-dc95-44b7-a6f4-efd61c8bc0fa None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.545067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.545881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.546165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.546441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.558910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:17.566682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:17.567937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 230/449] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:17.574583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.585070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ddc5b-956a-435e-8b24-fa49cd8c07f3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.590620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.591299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.591573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.591836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.592952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:17.593255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:17.595534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:17.605334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 220/450] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:17.612557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.623675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b19-c279-468d-8c6f-6f1e3b1ebc7e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.629497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.630140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.630418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.630686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.639899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:17.641719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:17.651814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 231/451] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:17.658940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.669051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05fa8-f415-4406-9586-7f37c7bb32a0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.674893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.675775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.676056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.676329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] PATH_INFO: `/v3/projects/8a6b08d818d54c3e97808ca092a07d94` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.677694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a6b08d818d54c3e97808ca092a07d94)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:17.679507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:17.681258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 221/452] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/projects/8a6b08d818d54c3e97808ca092a07d94 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:17.687624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.696851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa256e5-cabc-4c13-8aea-4dfbdc0a56f9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.701473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.702341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.702623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.702897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] PATH_INFO: `/v3/groups/028fda7c9065431890294f421137625f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.704249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] RBAC: Authorizing `identity:get_group(group_id=028fda7c9065431890294f421137625f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:17.706217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9202-5027-4451-aef1-823a8707f633 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:17.707837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 232/453] 10.222.0.30 () {56 vars in 1201 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/groups/028fda7c9065431890294f421137625f => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:17.714421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:17.725325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243829-4901-49ee-aae9-ad5e85ecae25 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:17.730397 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:17.731059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:17.731344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:17.731622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:17.732506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] RBAC: Adding query filter params (group.id=028fda7c9065431890294f421137625f, role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=8a6b08d818d54c3e97808ca092a07d94) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:17.732823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:17.734780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51628a-6ba1-45f7-bb57-aadad61765fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:17.741709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 222/454] 10.222.0.30 () {56 vars in 1397 bytes} [Wed Dec 15 16:08:17 2021] GET /identity/v3/role_assignments?group.id=028fda7c9065431890294f421137625f&scope.project.id=8a6b08d818d54c3e97808ca092a07d94&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:20.915794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f21a-789b-4885-9388-04c1e6a5899d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:20.916332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f21a-789b-4885-9388-04c1e6a5899d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:20.916332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f21a-789b-4885-9388-04c1e6a5899d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:20.918486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 233/455] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:20.925538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea8bf-aa07-4b3d-bcf7-21014f79cf04 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:20.926058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea8bf-aa07-4b3d-bcf7-21014f79cf04 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:20.926133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea8bf-aa07-4b3d-bcf7-21014f79cf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:20.949204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3f6ea8bf-aa07-4b3d-bcf7-21014f79cf04 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:20.950471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3f6ea8bf-aa07-4b3d-bcf7-21014f79cf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:20.963725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 223/456] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:21.011881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f21a-789b-4885-9388-04c1e6a5899d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.027302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f21a-789b-4885-9388-04c1e6a5899d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.036059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461285c-c097-4ce3-9a2b-c2b12ee0e328 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.036407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461285c-c097-4ce3-9a2b-c2b12ee0e328 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.036661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461285c-c097-4ce3-9a2b-c2b12ee0e328 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.038813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.039096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 224/457] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:21.040169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.040822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.041321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.045487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.046108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.046588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.072183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.074485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.089906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:21.091631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:21.102737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 225/458] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:21.104616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:21.106351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 234/459] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:21.117416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.134004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a5d1-3347-45e3-bd74-8c4ab6330ba5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.134557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.146607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.147633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.148120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.148781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.149738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:21.150264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.150915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3eb2-33ce-494e-816f-27edce23e57e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.152444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.166315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 226/460] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:21.169224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.170432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.172345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.173324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.174257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.192353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb835-2366-42f2-b942-fc8395a15da6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.197744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.200262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.206862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.207867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.208375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.210124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.211099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.219272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.238431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:21.239942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 235/461] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:21.246581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 227/462] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/users => generated 248 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:08:21.255316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.274205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48adfe-4d3f-411b-ae5b-fedbcbcb6e1f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.285392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.286087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.286362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.286634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.287401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:21.287702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.288791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:21.288791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:21.288791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:21.289691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62aef8-d4c1-418c-8f9c-e6e5af3a3c44 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.316284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 236/463] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:21.323393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.338740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14d87-6c11-4c94-a060-fecd5f995ede admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.353360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.354119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.354405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.354686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.355934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.358258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc396a-3785-46b6-ae5f-9a67c67766ea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.412581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 228/464] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/users => generated 246 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:21.503420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05c9c-44bd-4a56-9801-1ff28273967f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.503764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05c9c-44bd-4a56-9801-1ff28273967f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.504076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05c9c-44bd-4a56-9801-1ff28273967f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.506190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 237/465] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:21.520509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.520768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.521163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.549895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:21.551593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:21.552903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350e85-4ef9-4ccc-b82b-77bf1de07ea5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.553240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350e85-4ef9-4ccc-b82b-77bf1de07ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.553909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350e85-4ef9-4ccc-b82b-77bf1de07ea5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.557820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 238/466] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:21.560250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 229/467] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:21.567123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.567602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.568062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.615749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:21.617907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:21.623314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.640720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 239/468] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:21.640932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88909-c650-4801-b5fd-de9f0d9d30e6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.653461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.654785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.655296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.655778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.677488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.677865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.679412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.701517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b575-3b9c-412f-bb80-e73007855560 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.701727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:21.703320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 230/469] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:21.709972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.710352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.711459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.711910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.712376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.724848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36243-6006-4503-9247-ab1198f55295 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.732174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.733196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.733721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.736591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.736749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.737822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:21.738297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.738587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.740308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.755755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 231/470] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:21.762284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.771160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:21.773622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 240/471] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:21.775671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51376-e386-4709-bf2a-404212842726 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.781820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.783039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.783462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.783959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.784922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.785481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.787457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.805796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df009cb-b4bb-45b9-88b6-d6842830b514 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.811001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 232/472] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/users => generated 249 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:21.814115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.815239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.815782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.816305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.817780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:21.818376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.821459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ec8ba-74a4-4e00-85a3-c909b75fce3e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.845224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 241/473] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:21.855303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:21.869610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3156-9697-4713-912a-8d450d211831 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:21.877351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:21.878537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:21.879073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:21.879590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:21.880661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:21.882958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85c05-f132-45ba-9f02-e0b26eb9cb48 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:21.911955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 233/474] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:21 2021] POST /identity/v3/users => generated 248 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:08:22.704091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58f11-25c2-46ef-83cb-e5367d4e466d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:22.704757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58f11-25c2-46ef-83cb-e5367d4e466d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:22.705060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58f11-25c2-46ef-83cb-e5367d4e466d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:22.708783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 242/475] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:22 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:22.732778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:22.732778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:22.732778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:22.771763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:22.773909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:22.791478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 234/476] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:22.864708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b58f11-25c2-46ef-83cb-e5367d4e466d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:22.901686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b58f11-25c2-46ef-83cb-e5367d4e466d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:22.908785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:22.909839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:22.910301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:22.910780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:22.912159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:22.915221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:22.942302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.sql.core [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 16:08:22.942302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 16:08:22.942302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [parameters: {'id': '07043ca8df9e4d63ae013ab52d5b0c97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 16:08:22.942302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 16:08:22.977291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 16:08:22.980632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 243/477] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:08:22 2021] POST /identity/v3/roles => generated 144 bytes in 117 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:22.998460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:23.024722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483881c-8bda-4c04-8447-fe3e7ccc60be None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:23.034702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:23.035992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:23.036447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:23.036893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:23.065995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:23.081090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-272a6f12-8d0c-4ab1-b428-fb3795bcca33 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 16:08:23.083840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 235/478] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:23.094823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:23.109583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eb40a-73e3-4033-971e-667bbce42239 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:23.124454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:23.124454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:23.124454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:23.124454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:23.124824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:23.124824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:23.127190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5860c-ac09-4bac-a9e8-e78780198898 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:23.143639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 244/479] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:25.164476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9278-b8a8-481c-9f2b-765ffe887600 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.164476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9278-b8a8-481c-9f2b-765ffe887600 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.164476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9278-b8a8-481c-9f2b-765ffe887600 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.167419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 236/480] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:25 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:25.175472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.177067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.177833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.218425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:25.221159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:25.239689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 245/481] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:25.255090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd6ae-818e-4e20-a583-6fbd677caa0f None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.256034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd6ae-818e-4e20-a583-6fbd677caa0f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.256850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd6ae-818e-4e20-a583-6fbd677caa0f None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.260617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 237/482] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:25 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:25.266257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.269228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96262546-a66d-4bd4-bdc9-6e6b0a9c5531 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.270094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96262546-a66d-4bd4-bdc9-6e6b0a9c5531 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.270871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96262546-a66d-4bd4-bdc9-6e6b0a9c5531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.290451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952026-8748-42a9-a17a-45f4a8b650c1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.305044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.306282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.306754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.307202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.315042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-96262546-a66d-4bd4-bdc9-6e6b0a9c5531 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:25.316658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-96262546-a66d-4bd4-bdc9-6e6b0a9c5531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:25.323199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:25.325232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 238/483] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:25.332543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb1be-bde4-4a79-9f54-a7153e270e61 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.332543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb1be-bde4-4a79-9f54-a7153e270e61 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.332543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb1be-bde4-4a79-9f54-a7153e270e61 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.332885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:25.333258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 246/484] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.333355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 239/485] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:25.345762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.346630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.347108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.347594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.357968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c55f7f-a7a8-4a3b-a319-c9ab1b264238 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.367351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.368326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.368840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.369315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.370297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.370872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.372787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.383840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 247/486] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.388576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.390241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:25.392092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:25.401667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec7ae-aa55-4a50-afaa-d08cb9f9e099 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.406776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 240/487] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:25.407339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188db5-5875-441f-9083-794f45542305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.408472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188db5-5875-441f-9083-794f45542305 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.408860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188db5-5875-441f-9083-794f45542305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.409257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188db5-5875-441f-9083-794f45542305 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.409681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.421759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188db5-5875-441f-9083-794f45542305 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:25.426731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b571026-caf8-4fa8-bd00-6e3bed7642ca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.430239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-20188db5-5875-441f-9083-794f45542305 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:25.432056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 248/488] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.439098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188db5-5875-441f-9083-794f45542305 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.444089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.445560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.446055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.446541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.451340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188db5-5875-441f-9083-794f45542305 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.457020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.458140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.458642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.459106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.470009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.473794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.479801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:25.488306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:25.490193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 249/489] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:25.496965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.504648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:25.507048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 241/490] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.508575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.514342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab380dc-0fcd-41ce-bc61-cf5b6775b304 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.520247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.521216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.521708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.521962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804169d-9276-4f4e-91f3-494335e52146 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.522294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.523300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.523766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.526028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.527128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.528101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.528300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.528719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.529803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.529994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.531892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.537984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 250/491] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.539225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.546991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 242/492] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.552465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.556746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869928c2-7f56-4739-9521-5d169db11a50 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.559051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaaad-91ee-4c7f-a862-f5c02896230c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.562416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.563974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.564086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.564630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.564855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.565144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.565416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.565709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.566839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.567358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.569240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.577964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.579334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.584630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 251/493] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.585885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.598650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf264-7c47-4c59-8d8b-4b7a1b4be724 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.603711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.603874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:25.604937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.605383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 243/494] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.605870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.605986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.606444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.621125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.622399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce54a-8d9d-4339-a537-b35d91a5e9cb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.624206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.627592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.628508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.628822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.629108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.638868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.641232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.647224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:25.649204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 252/495] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.655807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.657477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 16:08:25.664107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 244/496] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.665709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.671345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40b07-2d8e-4b04-a487-59f596d3d9e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.677180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef34c5f-bf37-4a23-afcb-200a36c8d8b3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.678544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.679646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.680176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.680712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.681746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.682260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.684090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.689140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.690472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.690968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.691472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.693009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.693630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.697021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.701466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 253/497] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.702608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.713876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dec18-26c0-425b-a04e-b3393035a5f2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.720678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.720919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 245/498] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.721882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.727949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.727949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.727949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.727949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.727949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.728451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:25.728451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:25.728451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:25.729993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.739388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a934f-d445-4f73-94ef-799e07a3c39a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.744326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.745284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.748492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.748492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.755410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.757747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.773728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:25.775389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 246/499] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.776337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.785017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 254/500] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.786296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.792683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cae7-2d85-46ec-b6b2-21246ed5f60b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.798042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.798897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.799179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.799514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.800256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdaa9c-1076-4c23-b6e5-d945b88bebdc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.806123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.807148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.807825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.808387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.809069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.809685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.810168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.811576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.812957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.829930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 16:08:25.831327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 247/501] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.832320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.838218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 255/502] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.840026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.843499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96abc-bfb6-4f36-abfb-025b5720fc6e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.849329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.849623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.850057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.850453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.854080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf78a-5d49-4a0e-8b00-49aad7880c29 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.860465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.861367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.862327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.862810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.862916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.863356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.864471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:25.865102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.867246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.874582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 248/503] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:25.881225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.890925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f962e-787e-4a54-b0a4-05ded4e391c5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.893650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 256/504] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:25.895141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.896040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.896894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.897249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.897599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.906760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.908913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.909475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350653-1c64-4e49-9e9f-b7cbc9065156 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.915544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.917145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.917694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.918199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.919707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 249/505] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:25.920748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.931603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360fe7f-79c3-482b-80e9-55e585d6fe89 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.934785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.936667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.937550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.937833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.938183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.938816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.947523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:25.949846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:25.960185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 250/506] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:25.961256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.963496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:25.965173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 257/507] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:25.966501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:25.978366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02adb8-6211-4302-992e-56e2bf14cc20 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.980642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595c3f-a7d8-467b-aa40-8e0201fa74f4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:25.983633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.984892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.985057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.985447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.988122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:25.989770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:25.990243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:25.990779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:25.997976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.000399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.015912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.018006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.027154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:26.029063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 251/508] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.030952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.043351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:26.044837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 258/509] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:26.045745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.047054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba0ce-88c7-41ba-91d0-c455a3eeba83 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.053629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.055082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.055571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.056110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.056515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34698-bc83-4e30-a490-f0d7a23a0c03 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.057513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.058028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.060729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.061642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.062333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.062651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.062960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.063739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.064025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.068104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.089358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 259/510] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.090372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 252/511] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.090654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.102152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.105694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942fcf-767d-4f21-ae08-207ee613670c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.111751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.112393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.112755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.113022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.114054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.114213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.115786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.119914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a08a-90cb-4c76-b336-dcd748524b3e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.133624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.133624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.133624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.133624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.140910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.143804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.145514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 260/512] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.146597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.160309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-41c6d753-5f75-41f2-8dce-11cc86340d7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:26.161134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931e22-5636-4811-8c8f-e5c6511cf0b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.161772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 253/513] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.163056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9fd3-c7e7-43e5-97fa-61e29786c4ec None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.164064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9fd3-c7e7-43e5-97fa-61e29786c4ec None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.164064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9fd3-c7e7-43e5-97fa-61e29786c4ec None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.165721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 254/514] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:26.166572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a9fd3-c7e7-43e5-97fa-61e29786c4ec None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.169013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.169927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.170205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.170476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.178513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.181324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.183860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a9fd3-c7e7-43e5-97fa-61e29786c4ec None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.189110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.189917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.190196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.190467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.196730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:26.198354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.198766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 261/515] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.199830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.200314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.213919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133306-f671-443e-a143-164a0a99603e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.218267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2385bcbd-fdc6-409b-bcd7-2147bd967730 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:26.219534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.220455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 255/516] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.220594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.220995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.221416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.221824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.222107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.222387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.222943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.223377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.224634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:26.224634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:26.224634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:26.226097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.244148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:26.245415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:26.252491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 262/517] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.252491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.258040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 256/518] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:26.258761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.267517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c30e-f74d-45ac-81a2-d2e2f14c241e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.269556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596897bf-ec71-4681-ac90-75cbce407067 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.273377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.274234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.274538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.274958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.275100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.275237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.275557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.275783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.276385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.276784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.277080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.277519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.277907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:26.277907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:26.277907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:26.279180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.280055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.294698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 263/519] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.295837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.301150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 257/520] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.302050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.312187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b63f-7d82-4f84-837e-0425c5443b7f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.312854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d93c3-429e-46a3-93f8-99fa426ecb20 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.317298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.318129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.318410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.318683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.319100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.320027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.320498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.320924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.321935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.322393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.324418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.330732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 264/521] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.340759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:26.340860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.340939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:26.340939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 258/522] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.340939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.353022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3df4-8a4f-4a5e-b863-cd6d45b34dae admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.353266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b845e70-0be5-4bf0-8ea8-e79867914f94 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.357662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.358342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.358625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.358897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.359562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.360454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.360571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=3403d8ed438642c0a1a7fddce5762087) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.360874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.361037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.361407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.362475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=ab5f4ed434ad4685a93229ce1b6aef3d) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.362813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.362989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.365553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.371021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 259/523] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/role_assignments?user.id=3403d8ed438642c0a1a7fddce5762087&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.371912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.382953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 265/524] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/role_assignments?user.id=ab5f4ed434ad4685a93229ce1b6aef3d&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.383633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6115-88ca-4a33-bab2-a7911ff410c7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.418090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.418798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.419081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.419357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.420168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.420501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.422532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.448169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 260/525] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.455260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.471726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723699bb-48c5-4a7c-a6b4-96edfba63faf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.481499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.482652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.483103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.483481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.512597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.514834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.541242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:26.542535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 266/526] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:26.549575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.567172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122cd3b-2a97-4daf-9648-99b1a3ccb5af admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.577026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.577744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.578028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.578414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.579989 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.580298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.582061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.607163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 261/527] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.614254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.628203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724790-dc5d-421d-8610-6bcd2f038fff admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.636182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.637420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.637945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.638362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.651520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.654194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.670590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 16:08:26.672327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 267/528] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:26.681204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.697192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647afc73-115b-4ded-92c1-907bea05031f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.707149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.708177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.708630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.709135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.710164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.710703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.711894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:26.711894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:26.711894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:26.713437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.764892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 262/529] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:26.772180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.786973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec01c-f460-4445-9328-87236c4e7ef4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.793997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.794952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.795421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.795867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.807841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.809965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.823336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 268/530] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:26.830269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.846548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953384e-1223-4699-945b-3fdb47315365 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.855030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.856122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.856606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.857077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.873569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.876723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.898399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:26.899932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 263/531] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:26.906192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.921649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3119-2f90-40d5-8f90-1226bc92ed89 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.931085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.932049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.932527 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.932998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:26.933916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:26.934391 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:26.936160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:26.952018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 269/532] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:26.959100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:26.985071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b3572-c1dd-42d7-89d1-edec871535fc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:26.992544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:26.993913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:26.994403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:26.994892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.014073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.018323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.055367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:27.065287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 264/533] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:27.071618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:27.095979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdce6fb-dc50-4356-af3a-efe404f9d62f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:27.105558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:27.106585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.107062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.107556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.108598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:27.109103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.111952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556be79d-1b12-4ed9-aa50-89fc69c1137e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.138175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 270/534] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:27.148301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:27.164215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7877-e0c6-44c1-b3d5-2f0074cd6b50 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:27.172331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:27.173304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.173304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.173600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.174446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=cc0e23d5541646cb89418f0148187fe6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:27.174757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.176627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325fd8d-19e8-42c6-a177-ace59b2185fe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.189134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 265/535] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:27 2021] GET /identity/v3/role_assignments?user.id=cc0e23d5541646cb89418f0148187fe6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:27.279622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2118e-10cc-4684-9130-62d4e8fa1bf0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.280653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2118e-10cc-4684-9130-62d4e8fa1bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.281130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2118e-10cc-4684-9130-62d4e8fa1bf0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.283822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 271/536] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:27.290472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.290801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.291021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.321795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:27.323435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:27.348103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 266/537] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:27.414808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2118e-10cc-4684-9130-62d4e8fa1bf0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:27.431104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2118e-10cc-4684-9130-62d4e8fa1bf0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:27.441295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:27.442490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.442999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.443490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.457326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.459538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.483495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:27.485749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 272/538] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:27.496154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:27.520214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b3f0-3e65-464c-8d38-552281d742d3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:27.535952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:27.537139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.537629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.538120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.539518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:27.540058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.543276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9cad8-1f21-473c-816b-6c60ba044fca admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.580862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 267/539] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:27.590170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:27.606066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3512a1-c39c-4913-981d-dd970c70247f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:27.618585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:27.619688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:27.620164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:27.620659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:27.621597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:27.623743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03a3a-6a1d-4a51-8ebb-67b09ab4ae66 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:27.657355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 273/540] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:27 2021] POST /identity/v3/users => generated 247 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:29.385376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ee21-61c9-4c5d-a62e-0f9ac5b70ef1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.386118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ee21-61c9-4c5d-a62e-0f9ac5b70ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.386118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ee21-61c9-4c5d-a62e-0f9ac5b70ef1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.388237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 268/541] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:29.394547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ee78-7bee-4fca-921c-4a57fff4ea42 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.395312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ee78-7bee-4fca-921c-4a57fff4ea42 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.395312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ee78-7bee-4fca-921c-4a57fff4ea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.434206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2a83ee78-7bee-4fca-921c-4a57fff4ea42 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:29.436221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a83ee78-7bee-4fca-921c-4a57fff4ea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:29.455155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 274/542] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:29.464123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957dc7-ed66-4f6e-9de7-b77680042dbe None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.464661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957dc7-ed66-4f6e-9de7-b77680042dbe None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.465148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957dc7-ed66-4f6e-9de7-b77680042dbe None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.469238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 269/543] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:29 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:29.476726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.477230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.477939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.478930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957dc7-ed66-4f6e-9de7-b77680042dbe None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.502892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957dc7-ed66-4f6e-9de7-b77680042dbe None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.512723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.513531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.513796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.514039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.515485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:29.516776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:29.534033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:29.538690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 275/544] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:29.541598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:29.543100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 270/545] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:29.549555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.566956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2106592-7cdd-44be-81ec-8100dbc6bec8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.576346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.577429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.577928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.578659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.580195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.580737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.582567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.593382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.596879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 276/546] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:29.605208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.609784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822a41-30bd-475c-b9ee-b09131b9cc7d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.614758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.620645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.620645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.620645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.623368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674481e-0972-4c65-8971-71fc9993c372 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.634713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.635580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.635798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.636067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.647224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:29.654465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:29.655710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 271/547] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:29.661000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.662878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.666153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.688458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:29.688458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 277/548] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:29.689221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b43e-b80d-4ad2-b7c0-32f1c35830a6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.689392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.697063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.698372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.698860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.699331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.699729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836b0a-8b83-4ce2-9689-c9c45d0d82bb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.700665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.701283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.703429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.704694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.705546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.705829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.706108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.706846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.707148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.708815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.716484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 272/549] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:29.724919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.728666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 278/550] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:29.736480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.745820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995583a-9928-4a5e-9d30-96b636fa2581 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.754084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473e4d-17cd-4567-88a1-4f0d4f14d408 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.756907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.758767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.759633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.760852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.768615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.769788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.770277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.775341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.787464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.789078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.791193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.793673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.812394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 16:08:29.815764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 279/551] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:29.821387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.825902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:29.827748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 273/552] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:29.835415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.847615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed22410-61ba-45e5-a24f-bacba4384721 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.853032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.854035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.854530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.854848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a2b6-1602-48a5-8f41-a6e67a72f88d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.855205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.856242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.856788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.858606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.873514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 274/553] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:29.880425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.880753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.881938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.882425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.882919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.884584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.885173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.893117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b388841-edcc-479c-adfd-cb157be86557 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.897511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.898398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.899425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.899907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.900369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.911075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.913530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.932200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:29.934147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 275/554] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:29.942286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.949355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 280/555] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:29.954928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80645-18f4-4664-b2df-9b535a7ee182 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.955146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:29.960291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.961658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.962188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.962678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.963878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:29.964473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:29.966676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:29.976232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95d860-54ae-46f6-ba9a-ea05e7a282c5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:29.985924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:29.986806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:29.987178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:29.987457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:29.996821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 276/556] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:29.999223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.010866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d12b4-d414-49bf-979b-ee1cb19f82d1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.017023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.018234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.018683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.019097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.025075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.027072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.034904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.037078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.054214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:30.057534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:30.059280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 277/557] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:30.064991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 281/558] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:30.066490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.070843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.078095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dcb2f-b431-484f-a3f3-517db5bab8ac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.084497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.085329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83fee-e2a5-4ca7-8ee3-c4c27b5dbdbe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.085589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.086108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.086524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.087602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:30.088135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.090269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.090422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.090973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.091276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.091590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.092408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:30.093235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.095124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.107023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 278/559] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:30.114472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.123774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 282/560] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:30.126889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf651af-b3dd-4176-990e-00f47a4bffac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.129778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.132176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.133267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.133756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.134238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.143975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.146108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361fb2b-4798-470a-9f54-95cb94da0e36 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.146616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.158475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.159347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.159632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.159959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.164561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:30.166841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 279/561] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:30.173998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.181446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.183353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.185835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c8d4-3412-459b-8a59-a1d74792b189 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.192030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.193176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.193681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.194197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.195210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:30.195721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.198101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.206624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:30.207707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 283/562] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:30.212806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 280/563] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:30.218677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.220555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.231787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbb3b-85e1-41fa-a285-c7382acffdcc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.235065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a9a47-2f2c-479f-b650-12d050dc4e06 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.238155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.239419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.239902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.240392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.254585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.254585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.254585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.254585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.255246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:30.255552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.257618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92d43-8a83-4057-adfe-5c52a6136078 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.263451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=713e877ea43e442788f807e02578d0d6, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.267111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.286153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 281/564] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:30 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:30.298445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 284/565] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:30.304951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.418376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb02c52-a913-43c4-b01f-8897e9850439 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.428564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.429936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.430427 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.430899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/ab5f4ed434ad4685a93229ce1b6aef3d/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.455353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=ab5f4ed434ad4685a93229ce1b6aef3d, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:30.458559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0920-d853-49f5-b498-4b9163d8a22a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:30.482787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 282/566] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:30 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/ab5f4ed434ad4685a93229ce1b6aef3d/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:30.770124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678df7-81bd-4b99-a7e5-1281ab76da9b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.770636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678df7-81bd-4b99-a7e5-1281ab76da9b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.770636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678df7-81bd-4b99-a7e5-1281ab76da9b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.772586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 285/567] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:30.782659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.783018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.783235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:30.806312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:30.807618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:30.891534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 283/568] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:30.939044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678df7-81bd-4b99-a7e5-1281ab76da9b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:30.969782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678df7-81bd-4b99-a7e5-1281ab76da9b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:30.977867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:30.979208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:30.979702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:30.980193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.012204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:31.033245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e6efdbb2-0583-4495-bbcd-4ca2178bf814 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:31.036030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 286/569] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.046221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.057613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294c6-3f04-4475-8b2d-1452022a0128 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.058113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294c6-3f04-4475-8b2d-1452022a0128 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.058609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294c6-3f04-4475-8b2d-1452022a0128 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.060156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c05c8a-0ad4-4607-a07c-1fd009284629 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.064475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 287/570] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:31 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:31.074930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.075898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.076191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.076712 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.078890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.079457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.082345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.088858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.089363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.089922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.128645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 284/571] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:31.140741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:31.142920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:31.147343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.158770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31463-848e-4e33-b7e8-af4945ac4466 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.166547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.167937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 288/572] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:31.168624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.168899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.169165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.189160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.191016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.209781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.235103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd550eb-7848-4ad6-bca9-e13692974d50 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.236289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:31.237144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 285/573] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:31.243211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.243490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.244453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.245052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.245609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.254141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78cb2-1a42-4f67-80a3-3a72f44085e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.267927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:31.274290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.274970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.275250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.275519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.276283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.276606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.278237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.282318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:31.285161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 289/574] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:31.296828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 286/575] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.298256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.298457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.314127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dac41-50c4-4539-9a86-c376f615b1fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.314451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281123ee-fd72-4329-9b38-2b8de340a987 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.321374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.322363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.322824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.323257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.324808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.325314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.329534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.330501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.331559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.332318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.332856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.346341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 290/576] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.354281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.355645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.357034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.372588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ab06-6114-40d3-9fb1-6581b880aabd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.380835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.382190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.382638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.383137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.383367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 16:08:31.386011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 287/577] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/users/glance => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.395842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.407937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.409831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.410940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d7c90-297b-4fb3-ba0c-257932119979 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.415709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.416402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.416729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.416998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.417876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.418178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.420075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.446216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 288/578] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.452483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:31.453688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.455205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 291/579] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.464540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.479460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b14db-b4fc-4ac3-a2e2-9b6a46c98379 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.485910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb8e00-ac34-4379-9543-d44853307a90 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.491863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.492741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.493016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.493391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.496300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.497443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.497949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.498454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.499415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.500009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.503218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470af7a-c706-4ad5-9b69-92edba936d7f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.506988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.509660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.520567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 292/580] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:31.522690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc04ee-c479-4bb0-add1-a09ddd75aa8c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.523339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc04ee-c479-4bb0-add1-a09ddd75aa8c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.523833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc04ee-c479-4bb0-add1-a09ddd75aa8c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.531409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 293/581] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:31.533058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc04ee-c479-4bb0-add1-a09ddd75aa8c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.534551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-135e3a80-bd5a-4ec5-9f60-1f53ac7d9304 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:31.537255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 289/582] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.537728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.538007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.538280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.552903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc04ee-c479-4bb0-add1-a09ddd75aa8c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.558385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.559692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.560257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.560763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.568125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:31.569545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:31.571558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.574490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.588461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 290/583] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:31.588461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.593086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d75274-e64f-430f-9a69-330d24d71e9f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.598401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.599141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.599421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.599747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.600549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.600992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.601956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 16:08:31.608461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.610046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 294/584] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.617865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 291/585] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.620073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.624009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.634265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd8a2-f20a-48af-b934-72efaf6a83cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.637277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c5c8-d019-4a01-a4e0-c620e38f6053 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.640197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.641397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.641950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.642482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.643035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.643754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.644027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.644409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.644642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.644915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.647172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.654696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.657785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.670192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 295/586] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.671626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.675857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:31.677591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 292/587] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:31.683581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.687087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f9d9-bc95-41bc-a717-96ee45a7cc40 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.694175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.694921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12da2-a168-47aa-8a76-11e10d90dc48 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.695839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.696387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.696986 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.699937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.700815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.701087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.701362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.712663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:31.715140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.717073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.721912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:31.723565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 296/588] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.729716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.737985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:31.739724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 293/589] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.741157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.743443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704e8e-bd78-408e-9fb8-271bfbabd2ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.750834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.751531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.751807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.752077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.752971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.753282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.755233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fbbcc-6531-4aaa-a7e4-c52cb45640d8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.755412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.762549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.763655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.764148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.764625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.765641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.766195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.768229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.774503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 297/590] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.775362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.785159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 294/591] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:31.786586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.786897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e246ea5-d904-4228-81d6-3360b8f0bd40 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.792322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.793173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.793547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.793883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.794744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:31.795776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.797035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.800232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c337d61-2cc5-4f0e-ae30-6299d314fcb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.807562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.808964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.809424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.809871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/3403d8ed438642c0a1a7fddce5762087/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.812356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 298/592] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:31.813425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.833323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=3403d8ed438642c0a1a7fddce5762087, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.837791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.842190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bc339-f23f-4b4a-9a6f-a8031d789332 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.850433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.852245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.852245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.852729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:31.862687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 295/593] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:31 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/3403d8ed438642c0a1a7fddce5762087/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:31.864347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.875058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:31.879429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:31.913045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:31.915693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 299/594] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:31.926701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:31.944897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad67fa-7e8b-4d7b-852f-fac84f534b11 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.979824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cec3b-d41b-4135-b02e-ad7440ce504b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:31.988677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:31.990535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:31.991363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:31.992166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.009582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.016643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.044137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:32.052629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 296/595] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:32.058464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.066853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.068182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.068742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.069440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.071294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.071853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.076411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.080935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3686-6f0a-43b2-ad5f-7b9be6e2dd23 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.088830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.090507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.091270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.091993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.094178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.095063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.099226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.100357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 300/596] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:32.111954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.136523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 297/597] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:32.149022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49596b8f-0688-4845-b8d0-622195b7c231 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.158900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.160367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.160558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.160859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.161389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.186598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.190831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.196734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff9cf-f119-4198-b00f-0fb12bc10a2d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.213934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.216702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.217734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.218557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/cc0e23d5541646cb89418f0148187fe6/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.245450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:32.249465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 301/598] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:32.260295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.270331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=cc0e23d5541646cb89418f0148187fe6, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.275538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.284078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafa9df-2b3e-439e-b8e9-c28825946bad admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.292393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.293873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.293873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.293873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.294552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.294836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.296904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.309299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 298/599] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:32 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/cc0e23d5541646cb89418f0148187fe6/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:08:32.338682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 302/600] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:32.350400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.487364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b02b-8a88-428d-821e-90a58b6dbaab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.499402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.500592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.501200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.501530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.521306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.531390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.555029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 299/601] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:32.566100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.584167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8d0d-23b5-4324-a2fb-975adfdd5d82 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.592235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.594334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.595280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.596046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.615613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.619423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.653780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:32.661017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 303/602] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:32.667905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.684280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8610119-a22a-42f1-8a69-7ff055d8f90f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.692375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.693962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.694647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.695329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.696986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.697780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.700892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.723562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 300/603] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:32.735172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.754870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4e42d-ba87-4300-9ca2-cad13f6e853d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.763255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.764988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.765820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.766550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.779718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.785403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.812852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:32.815701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 304/604] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:32.827819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.849570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91e9ea-1217-41aa-bb3b-61e4e7fa132b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.858434 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.859659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.860194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.860718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.862240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.862748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.869238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0623-e7e4-4125-9b3a-2d63d413292d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.892771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 301/605] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:32.903758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:32.925107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab46e9-926a-44d5-beb4-3691bd55bc78 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:32.933287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:32.934688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:32.935382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:32.936059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:32.940380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=a8dc448d7e48411eac14da58bb0fde06) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:32.941223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:32.945117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f30b3-59a3-4cd5-ac7b-53c2c14c1507 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:32.960977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 305/606] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:32 2021] GET /identity/v3/role_assignments?user.id=a8dc448d7e48411eac14da58bb0fde06&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:33.590630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c0d-f2f3-4d32-a010-d34e2bbe555d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.592148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c0d-f2f3-4d32-a010-d34e2bbe555d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.593185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c0d-f2f3-4d32-a010-d34e2bbe555d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.596902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 302/607] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:33 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:33.603415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.604197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.604942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.629667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:33.630910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:33.639089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 306/608] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:33.681062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d0c0d-f2f3-4d32-a010-d34e2bbe555d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:33.711819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d0c0d-f2f3-4d32-a010-d34e2bbe555d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:33.722210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:33.724035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.724854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.725766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.745786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:33.759998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:33.763038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 303/609] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:33.769754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:33.786108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aa8b1-8a9b-46aa-abc8-c2968a8143a2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:33.794439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:33.795899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.796745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.797551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.799280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:33.800119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:33.803462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:33.820348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 307/610] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:33.830742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:33.854102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccea70-7b09-4e9f-9756-813d26bc8b83 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:33.865191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:33.867018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.867822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.868567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.894794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:33.898851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:33.943092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:33.946095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 304/611] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:33.953623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:33.980462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4ea1-f441-4111-a977-63ee177e1eae admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:33.989807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:33.990493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:33.990787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:33.991049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:33.991774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:33.992077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:33.993721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34924-5424-48cb-886e-f31e6a9f526d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.013739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 308/612] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.020405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.045666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc8cd8-743d-4d97-b83b-2f3ef09ebcb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.052820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e29de-ca4e-4776-81b2-1766bfb7388c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.053151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e29de-ca4e-4776-81b2-1766bfb7388c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.053395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e29de-ca4e-4776-81b2-1766bfb7388c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.055441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 309/613] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:34.060142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.061520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.061800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.062070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.063583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.064009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.064412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.082371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:34.083824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:34.086969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.089056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.102141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 310/614] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:34.115958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:34.117498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 305/615] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.123386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.138264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879668-e0d4-4c31-acf8-d2dcdd889d78 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.148736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.149474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.149749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.150020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.150873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.151180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.153352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.159531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.173814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ab5b-ae39-4155-b874-ba4c77b485a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.181715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.182532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.182802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.183071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.195487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 311/616] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.201818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:34.206357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.216240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:34.217017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5032-161d-44ab-908f-97ce3d71c043 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.218669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 306/617] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.225208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.232290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.233021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.233296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.233559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.244416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd6498-fd07-4e82-97e9-58998b10188b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.247740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.249531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.259900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.260120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 312/618] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:34.260683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.260962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.261233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.262001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.262303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.263889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.279081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 307/619] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.279511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.290083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.291787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc57f5-b704-42bd-b001-a7d5428e0a3a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.296677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.298388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.298860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.299305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.306908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02616-5a62-489f-be82-7daef2a8079e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.319710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.321811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.323006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.324248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.327244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.333313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.345985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.348171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.367213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:34.369169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 308/620] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.377556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.382322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:34.384835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 313/621] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.393710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.394590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2db55-9c6c-43ba-b327-ef1d89d966f2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.404597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.405275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.405556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.405810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.406596 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.406901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.408512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.414366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14410f-865a-4326-9819-016d45015c74 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.425649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.426321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.426604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.426876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.427616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.427907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.429578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.431402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 309/622] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.438428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.456488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 314/623] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:34.456488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.458188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633180-4efc-4a43-8cad-80d5f3f1f019 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.465422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6852a0-d94a-4663-8a8b-e3e19450a9b7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.468314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.469689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.470412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.470643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.471060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.471628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.476472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.476472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.484954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.487252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.502399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.505049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.515047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:34.533323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 315/624] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.535376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 16:08:34.542054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 310/625] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/users/cinder => generated 84 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:34.543740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.551509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.563536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a31bb-a638-4857-b89a-b6bb8c0201c0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.563845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c1e1-e05b-494c-9035-3932a11f837a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.575479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.576376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.577256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.578045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.578494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.578862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.579247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.580003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.581284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.581626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.582023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.583627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.586236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.587189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.612483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 311/626] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.613893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.627889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4d2e-7e44-4ad6-b1b0-e276c140f703 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.639767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 316/627] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.642051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.643206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.643878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.644626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.644899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.648425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.648762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.652960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.664113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80098f-045e-4d19-8237-bc1d1191cf16 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.680628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 312/628] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.689482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.690296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.690576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.690847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.705134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.706944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.723670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 317/629] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:34.734391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.759244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186be07-8485-45d8-b2b6-3836d2fbf374 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.772415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.773800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.774338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.774820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.803979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.807832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.842369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:34.844999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 313/630] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:34.856513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.873289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c2ef-fecc-4736-95e2-584d92176820 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.889136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.890282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.890812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.891309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.892742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:34.893280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:34.901381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9299d1-8dda-4af9-a6db-ce4a085011cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:34.936936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 318/631] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:34.947998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:34.967634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be64-403e-46f1-b1da-b0f0017cd6df None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.970862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be64-403e-46f1-b1da-b0f0017cd6df None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.970862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be64-403e-46f1-b1da-b0f0017cd6df None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.971317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7184-c94d-4a41-bfe9-7c9790bc5f0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:34.976468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 319/632] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:34 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:34.984600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09289a-9683-445d-81bf-27475793b36d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.985105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09289a-9683-445d-81bf-27475793b36d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.985647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09289a-9683-445d-81bf-27475793b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:34.990763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:34.993471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:34.995145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:34.996596 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.027611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.031744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.046071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6f09289a-9683-445d-81bf-27475793b36d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:35.048158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6f09289a-9683-445d-81bf-27475793b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:35.058999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:35.060783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 314/633] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:35.065858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 320/634] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:35.071198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.089439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f099f-179a-474e-bb7a-c40229a2b096 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.096010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09289a-9683-445d-81bf-27475793b36d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.096713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.097480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.097821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.098160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.099088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.099460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.101447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.110436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09289a-9683-445d-81bf-27475793b36d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.116124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 315/635] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:35.121310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.122375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.122752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.123121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.131801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.143448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262412-01be-4e99-8ad8-2c7aa713dd12 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.147049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:35.154559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:35.156006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 321/636] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:35.161424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.163127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.164321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.164792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.166502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.167429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=ab5f4ed434ad4685a93229ce1b6aef3d) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.167803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.169811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.177417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 316/637] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/role_assignments?user.id=ab5f4ed434ad4685a93229ce1b6aef3d&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.178877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99863a4-1b13-4fb0-b8fb-9562803f3e61 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.183767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.184665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.185047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.185419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.186321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.186727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.188682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.199891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 322/638] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.207075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.219860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ed08-f91b-4dcf-a1ee-80b2e63caf0b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.231313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.233139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.233856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.234765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.261418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.265423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.298853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:35.301189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 317/639] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:35.308786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.320633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cecd2-08ac-46d2-9b19-424fcc2edaed admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.327944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.328866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.329253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.329743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.330630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.331040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.332867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.355332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 323/640] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.362815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.384757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bad4e9-0227-427f-a039-38ab5639bb86 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.395374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.397142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.397785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.398285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.417921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.420154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.440372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 16:08:35.442107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 318/641] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/users/glance => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:35.448459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.459579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354a89-858b-47de-8839-41cadf1d9fb5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.468744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.469893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.470270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.470636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.471609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.472035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.474047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.499228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 324/642] 10.222.0.30 () {56 vars in 1158 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.506609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.532903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09559d0-b995-40c3-9be3-4c54d77e9df0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.547156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.548564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.549188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.549836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.574462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.579163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.604556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 319/643] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:35.610281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.621990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616a0be-f366-4fd8-b113-550d22776a21 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.631907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.632834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.633247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.633618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.658693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.662332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.703201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:35.706073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 325/644] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:35.712630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.722846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed561-32bd-4808-a770-8a0a826c95c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.728462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.729140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.729472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.729724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.730425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.730728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.732342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.748564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 320/645] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.756000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.779844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec6bf-ad82-4062-9a03-af19207f1f5c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.789284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.790720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.791237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.791719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.806168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.809989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.829398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:35.830760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 326/646] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:35.837183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.855312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f050-5a7f-4074-b400-1c40c14f2291 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.865120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.865800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.866081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.866335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.867149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.867452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.869333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8601930-d2ef-4e19-bfb6-cef8ef9f9eea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.891569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 321/647] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:35.898115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:35.916183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9de797-65ae-4d10-b313-07aade0dc1c1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:35.923091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:35.924747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:35.925018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:35.925287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:35.926210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=3403d8ed438642c0a1a7fddce5762087) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:35.926519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:35.928454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879e5b-80a5-4010-9cd2-87e7365cac5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:35.937348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 327/648] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:35 2021] GET /identity/v3/role_assignments?user.id=3403d8ed438642c0a1a7fddce5762087&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:36.477759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2921ba-1442-4104-b963-c6d1b208ee33 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.477759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2921ba-1442-4104-b963-c6d1b208ee33 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.477759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2921ba-1442-4104-b963-c6d1b208ee33 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.478777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 322/649] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:36.487397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.487397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.487397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.507485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:36.509059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:36.526196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 328/650] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:36.554720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2921ba-1442-4104-b963-c6d1b208ee33 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.569651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2921ba-1442-4104-b963-c6d1b208ee33 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.575608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.576412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.576784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.577056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.588509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:36.595829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-bf8779c6-a2e2-4139-b737-225553c2d1e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:36.602436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 323/651] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:36.603844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.618057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bd641-0f30-4723-96eb-78d77d4ba818 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.628914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.629852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.630273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.630719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.631638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:36.632083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.633865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.638984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c585-515b-4561-863c-6dd8d32c45d5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.639675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c585-515b-4561-863c-6dd8d32c45d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.640277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c585-515b-4561-863c-6dd8d32c45d5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.644893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 329/652] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:36.650500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 324/653] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:36 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:36.654934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.658888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.659398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.659841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.666905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d131a3e-d6a2-4089-a937-cae2282622a4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.676733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.678918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.679053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.679328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.692550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.695181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.701714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:36.703915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:36.712945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:36.714515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 330/654] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:36.725848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.733526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 325/655] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:36.738934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35edda-92dd-4279-b666-e76fd1cdb7a5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.759278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.760480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.760807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.761182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.762615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:36.764423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.768907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.772106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.783945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfae65-4aac-4ae3-a4a0-618e0c471460 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.788711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 331/656] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:36.795897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.798213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.802383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.802765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.803040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.815534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21754-1992-4e02-aa24-35dd8ad0f19f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.827450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.828611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.829306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.829580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.831009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:36.848253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:36.850606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.851658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 326/657] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:36.853282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.860717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.879963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 16:08:36.881600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 332/658] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:36.886460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e928eb3-5351-4b1a-99c5-419d65910af3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.898818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.905418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.906517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.906965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.907429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.908746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:36.909216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.910156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a60-4102-4e7e-a9d5-c320f9de68cb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.912244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.928477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.929649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.930087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.932626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:36.935412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:36.935875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:36.948072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 327/659] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:36.948507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:36.970918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:36.982620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d910-4aeb-4fe6-9915-7e99ba399758 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:36.988631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:36.989386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:36.989672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:36.989949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.000622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 333/660] 10.222.0.30 () {56 vars in 1160 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:37.008091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.011162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.011914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.032801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:37.034392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 328/661] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:37.038571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb65bf-7c1f-4e09-9401-c3f2c220a108 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.040618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.043455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.044196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.044506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.044807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.053935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.055766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.064942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b51dd-c1a6-4f2b-9a25-673c433e8dc4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.066599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 334/662] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:37.071941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.072672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.072954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.073226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.074011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.074315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.075848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.084601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.088775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821270-3afb-4abc-88d9-908ea8b16007 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.099375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.100236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.100545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.100825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.114364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 329/663] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:37.118866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.120560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.127155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.140258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5992d-096f-4d21-ac09-6550a1a29d1f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.144952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.145782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.146062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.146335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.159609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:37.161079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 335/664] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:37.169982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.170725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.172494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.187287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdc172-8c8b-45b9-872e-a0f27e77aa85 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.194753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.195860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.196360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.196966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.197603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:37.198203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.198754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.201668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.205151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 330/665] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:37.215079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.236260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 336/666] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:37.247587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61c60-f0cb-4505-8a0e-80fd2ebc37f8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.269972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.271333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.271838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.272405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.274196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.274756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.278767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.284476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.301982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ea70-1cb2-4edc-a3b6-77fe00cc3896 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.312935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.314517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.315016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.315544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.321084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 331/667] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:37.342634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.342955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.347243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.382170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a19a1-19d9-467f-8a38-80b2ad3a3134 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.397351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.400273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.400850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.401329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.406181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:37.411842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 337/668] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:37.423027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.432207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.436025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.453899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318014c-6d9e-4ff4-a02e-7469b784ac8b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.470976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:37.473646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 332/669] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:37.474874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.476171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.476692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.477181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.478902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.479445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.484265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.487435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.517197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a006-e764-4a8f-bf5b-cc954fd2f5b9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.530266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 338/670] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:37.531324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.532563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.533034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.533509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.534966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.535509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.538031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.538281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.560419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f3892-3784-470e-bcd6-72b972a0f71a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.565129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 333/671] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:37.575418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.585238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.585923 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.586226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.586482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.587327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=cc0e23d5541646cb89418f0148187fe6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.587639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.589561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.593736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955ad84-b251-4199-bd8d-6a742eddbfe6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.601649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.603108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.603634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.604104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.607222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 339/672] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/role_assignments?user.id=cc0e23d5541646cb89418f0148187fe6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:37.625360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.635221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.668584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:37.670290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 334/673] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:37.680152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.694295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad93f8-8fbb-460d-8cff-9b520b471e50 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.704832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.705526 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.705811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.706091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.706918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:37.707230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.709215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6823d-5db8-4b1a-a11f-0272a11e1689 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.741788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 340/674] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:37.751587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:37.766299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7b38-624b-4b62-ac1a-518d8be72893 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:37.772845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:37.773686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.773972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.774256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/a8dc448d7e48411eac14da58bb0fde06/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.805375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=a8dc448d7e48411eac14da58bb0fde06, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:37.808158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6853e-a9e8-4558-8ba7-3d329c889c2d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:37.836523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 335/675] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:37 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/a8dc448d7e48411eac14da58bb0fde06/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:37.985769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d3d-489f-4a57-ab56-6879d7966bb0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.986744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d3d-489f-4a57-ab56-6879d7966bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.986744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d3d-489f-4a57-ab56-6879d7966bb0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.988603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 341/676] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:37.995300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.995726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.995946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.025850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:38.027035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:38.108953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 336/677] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:38.134726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409d3d-489f-4a57-ab56-6879d7966bb0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.148622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409d3d-489f-4a57-ab56-6879d7966bb0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.153695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.154679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.154963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.155208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.169925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:38.177736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:38.179365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 342/678] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:38.185907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.196137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38dcaf-51ee-436b-9adc-5ab9d8558978 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.201284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.202000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.202283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.202550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.203926 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.204248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.206221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.217467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 337/679] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:38.224717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.235818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3575f-529c-4f84-a347-7cee140c68d9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.241002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.241870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.242162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.242405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.255583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.257637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.278326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:38.279853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 343/680] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:38.293556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.303890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a57e0-f982-4150-ab00-15ab3b5b1f22 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.312943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.314317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.314775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.315205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.316111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.316599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.318461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.336479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 338/681] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:38.342660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.357685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5c09c-7a95-4684-a162-25b0e58a6a1d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.366630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.367692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.368114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.368567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.378331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.380636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.398968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:38.400482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 344/682] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:38.406878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.421871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9c2-5c7a-41af-ba01-2327b112e06c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.430909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.431864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.432288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.432756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.433795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.434264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.436296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.478629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 339/683] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:38.485577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.502485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082b34-44b9-4f41-aa2a-4ac1bd19e414 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.512854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.513736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.514157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.514595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.534476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.536573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.551339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 345/684] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:38.561686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.587502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89ff1-d712-4e0f-9fe2-a8acc7f2d79a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.592170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.593009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.593595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.593984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.612728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.614587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.641620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:38.643267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 340/685] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:38.652755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.680400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3d6f-f8d1-4560-bad5-0089cc341bed admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.694959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.696560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.697317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.698084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.699731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.700546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.703971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.737374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 346/686] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:38.746424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.761966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7d72-696e-47b6-8e77-6505a36f49ed admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.766787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.767597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.767873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.768203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.789824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.791725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.819356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6f9d9e4a-9833-4017-827c-5af1ada866da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:38.822297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 341/687] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:38.831995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.853147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0660f-f205-450a-808b-68ab70ad22e6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.862973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3087b-9bef-4087-a622-685e93bd79c7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.863822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3087b-9bef-4087-a622-685e93bd79c7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.865086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3087b-9bef-4087-a622-685e93bd79c7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.867263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.868334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.868864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.869291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.870177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 342/688] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:38 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:38.873058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.873252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.878455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.905788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757990-e557-471b-b151-495701967a76 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.907264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757990-e557-471b-b151-495701967a76 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.908049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757990-e557-471b-b151-495701967a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.909909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 347/689] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:38.919652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.944789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06e39-1222-4d82-a9e2-e7945babadca admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.950200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-df757990-e557-471b-b151-495701967a76 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:38.951830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-df757990-e557-471b-b151-495701967a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:38.956088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.956783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.957071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.957329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.958210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:38.958479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.960328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.970835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 348/690] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:38.973279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 343/691] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:39.014153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:39.032558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf012ce-c002-4b3c-9ed6-b685701b1bc7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:39.040767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:39.042148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:39.042688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:39.043163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:39.044463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:39.046313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:39.046313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:39.046313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:39.048869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:39.074947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 16:08:39.081576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 349/692] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Dec 15 16:08:39 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:39.088905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df757990-e557-471b-b151-495701967a76 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:39.106144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df757990-e557-471b-b151-495701967a76 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:39.113517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:39.114628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:39.115099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:39.115873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:39.117307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:39.117830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:39.119814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:39.119814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:39.119814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:39.121437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0806d-4e0a-4e2d-ac33-98abe918165d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:39.135237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 344/693] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:39 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:39.141812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:39.161453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493e5-204f-4559-8aa4-a2adde0e8d6a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:39.184351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:39.188373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:39.189003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:39.189401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:39.190696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:39.191168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:39.192934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:39.192934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:39.192934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:39.194502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87fd66-71d3-4ce1-9dda-c11af2b88c5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:39.210338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 350/694] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:39 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:40.301119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68470de-041c-4605-b12a-e82fd59de1f9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.302082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68470de-041c-4605-b12a-e82fd59de1f9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.302082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68470de-041c-4605-b12a-e82fd59de1f9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.305877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 345/695] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:40 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:40.317761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.318695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.318920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.354139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:40.356293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:40.380725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 351/696] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:40.419163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68470de-041c-4605-b12a-e82fd59de1f9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:40.441911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68470de-041c-4605-b12a-e82fd59de1f9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:40.448470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:40.449911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.450341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.450751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.470639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:40.473785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:40.506714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:40.516617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 346/697] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:40.520845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:40.536909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5751c-e588-4ddd-9247-ccdeb156cd4f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:40.544181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:40.545357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.545825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.546297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.547692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:40.548231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:40.551270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb788-37d2-4ad9-8810-23ed38071eb6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:40.580636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 352/698] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:40.587008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:40.605835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d54-8d5f-4826-a137-76a7243a3f03 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:40.617554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:40.618730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.619221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.625483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.626919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:40.631009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0d16-8b11-479e-bb37-f3ed4dff1b93 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:40.674302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 347/699] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:08:40 2021] POST /identity/v3/users => generated 254 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:08:41.674819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96193bc-14e9-4d9b-b4be-1e2d7e47ab6a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.675554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96193bc-14e9-4d9b-b4be-1e2d7e47ab6a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.675806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96193bc-14e9-4d9b-b4be-1e2d7e47ab6a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.679674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 353/700] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:41 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:41.690814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.691484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.691791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.732579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:41.735072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:41.755336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 348/701] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:41.807632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96193bc-14e9-4d9b-b4be-1e2d7e47ab6a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:41.829059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96193bc-14e9-4d9b-b4be-1e2d7e47ab6a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:41.836707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:41.838090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.838585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.839073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.870119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:41.881974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:41.888722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 354/702] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:41.895278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:41.911401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f15db-770d-4cda-ad64-4558e309dc84 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:41.918986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:41.920154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.920686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.921179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.922693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:41.923509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:41.926798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:41.943347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 349/703] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:41.953802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:41.971124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124546d-0574-458e-b765-54d209a3608c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:41.977961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:41.979164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.979586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.979999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.997605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.000974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.030569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:42.033205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 355/704] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:42.043123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.058471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52292c-fc00-4599-bc52-c11134217bb1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.065643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.066749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.067173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.067638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.069000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.069475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.072245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.102981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 350/705] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.114106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.134744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818079c-0272-4161-965f-993c190307a1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.142226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.143512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.143936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.144356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.158427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.162271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.188206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:42.190567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 356/706] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:42.203251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.219789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3374-6d40-4efd-befb-80423f42e9b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.226691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.227834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.228342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.228832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.230386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.230899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.234419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.267903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 351/707] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.278297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.295395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6019-6cf1-450e-9c0e-69b0002fe12f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.302381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.303612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.304093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.304609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.320799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.324474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.342684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 357/708] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:42.353234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.374648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084a7-beee-4609-9e89-e631ce6a3909 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.384930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.386416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.386833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.387311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.410494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.414072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.460090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:42.471177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 352/709] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:42.480545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.508609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13fb4a-09af-48cd-bf64-c0a4abddeef1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.525696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.526792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.527228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.527665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.528948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.529445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.532318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.568548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 358/710] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.577841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.608762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa4c1b-175a-4b0e-8783-50cb9b597d01 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.624020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.625387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.625862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.626307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.637797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.642677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.657794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4c139354-e892-434a-9d23-72e7a3df5341 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:42.659507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 353/711] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:42.669615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.693894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e43-c414-49f8-bc6e-7f76a4c613ea None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.694554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e43-c414-49f8-bc6e-7f76a4c613ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.694554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e43-c414-49f8-bc6e-7f76a4c613ea None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.695525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768a3b-baaf-403c-875e-885c570451cd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.696375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 354/712] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:42.707178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.707860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.708139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.708412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.709257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.709565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.711510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.717160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.717471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.717699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.737369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 359/713] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.745560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.765483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7767b-fe61-4064-ad38-866c05b004c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.767322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:42.769895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:42.774949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.783458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.783458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.783458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.783458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=a8dc448d7e48411eac14da58bb0fde06) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.783458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.784380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.791533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 360/714] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/role_assignments?user.id=a8dc448d7e48411eac14da58bb0fde06&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.802456 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 355/715] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 16:08:42.839129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.854197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ce57-6030-4edd-860e-16d3765fdfc8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.859313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.861223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.861721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.862212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.863121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.865378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.878158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 16:08:42.880085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 361/716] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:42.886498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.896882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b7309-daa0-4b7b-8c50-e61b704d9906 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.904984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.906110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.906800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.907566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.908745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.909727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.911746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b43e6-8c6c-4e21-846b-5c2f33e31337 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.917557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 356/717] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:42.925626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:42.936697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfc1e-6c59-4bd7-9233-def2b87f8f1b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:42.949173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:42.950286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:42.950769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:42.951244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:42.952244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:42.952859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:42.955350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d979dc7-d6d9-4db6-a4d6-a787e1c0383b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:42.964942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 362/718] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:42 2021] GET /identity/v3/services?type=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:43.087906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d437-29e1-4aa0-96ff-1966e69879a7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.088644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d437-29e1-4aa0-96ff-1966e69879a7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.089198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d437-29e1-4aa0-96ff-1966e69879a7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.091649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 357/719] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:43.099190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9880-11e9-4da4-9a14-cb3f74bba85b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.099870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9880-11e9-4da4-9a14-cb3f74bba85b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.100341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9880-11e9-4da4-9a14-cb3f74bba85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.121236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6f4f9880-11e9-4da4-9a14-cb3f74bba85b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:43.122860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6f4f9880-11e9-4da4-9a14-cb3f74bba85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:43.132105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 363/720] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 16:08:43.157200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4d437-29e1-4aa0-96ff-1966e69879a7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.170219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4d437-29e1-4aa0-96ff-1966e69879a7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.170945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c207-939b-49c5-b794-8c5d6845a7e8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.171392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c207-939b-49c5-b794-8c5d6845a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.171854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c207-939b-49c5-b794-8c5d6845a7e8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.175181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 364/721] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:43.176893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.177857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.178346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.178820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.179758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.181000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:43.181000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:43.181000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:43.182233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.186176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.186680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.187173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.202912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 358/722] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:08:43 2021] POST /identity/v3/services => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:43.234864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:43.237055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:43.283451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 365/723] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:43 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:43.334312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.353438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e8548-06c6-4841-bc0a-93995b61ae7a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.358719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.360111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.360962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.361461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.387960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:43.402266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:43.405672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 359/724] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:43.416398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.436331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694cd1e-2928-43c3-a617-982f2cda3553 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.445204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.446378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.446865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.447382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.448898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:43.449441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.452638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.470353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 366/725] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:43.480921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.499208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34886-5568-414b-96f4-bdd1605bcf48 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.507123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.508561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.509047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.509591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.528883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.532688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.566367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:43.569220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 360/726] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:43.579784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.598069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce183d1-75a4-44f4-96ab-de5f5da5052e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.605869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.607125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.607619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.608158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.609748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:43.610344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.613469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.637350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 367/727] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:43.647765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.666350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d878-ef0a-45e5-b058-2f26a42b421d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.674324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.675747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.676300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.676829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.691569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.695918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.724706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:43.727366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 361/728] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:43.738881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.757568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5aa4-b4e1-4c02-b621-6dbb94f406c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.765266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.766927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.767113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.767510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.769210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:43.769761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.773568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.808207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 368/729] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:43.819536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.838894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af79e0-466c-49c7-8eed-7f3af8574c1f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.847523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.849101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.849601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.850094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.869231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.872895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.915200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:43.917857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 362/730] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:43.928393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:43.946782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d08056-62f1-4c9d-b364-7e526eca64bd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:43.956419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:43.957570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:43.958146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:43.958630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:43.960159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:43.960733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:43.963944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:43.990464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 369/731] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:44.000960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.033352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0585e-3528-44d7-9680-efb326c383d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.042610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.044018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.044536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.045024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.062604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:44.066546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:44.091770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:44.094983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 363/732] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:44.104882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.142712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169b022-fb0c-47ce-a8ec-6b9f20c79079 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.159285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.160533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.161061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.161552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.163120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:44.163669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:44.167434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edef68-c30f-4a40-807c-6ac7c872c5c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:44.195528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 370/733] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:44.202183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.223536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5130-d224-41eb-bf3c-59caacde8b73 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.232349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.233636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.234121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.234672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.242135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=713e877ea43e442788f807e02578d0d6, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:44.245281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40a43-6a5e-4dc0-93f4-6a66860bae0a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:44.271301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 364/734] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:44 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:44.517292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c540-7140-4637-93b3-ab2f94062d6c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.517783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c540-7140-4637-93b3-ab2f94062d6c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.518255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c540-7140-4637-93b3-ab2f94062d6c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.522120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 371/735] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:44 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:44.531922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.532360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.532967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.563204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:44.565697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:44.672338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 365/736] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:44 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:44.711118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496c540-7140-4637-93b3-ab2f94062d6c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.735352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496c540-7140-4637-93b3-ab2f94062d6c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.742303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.744416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.745090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.745698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.764338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:44.778382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:44.781321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 372/737] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:44.790168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.812715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f876ee-d5e3-4f6f-b932-06ad798ef556 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.827097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.828218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.828800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.829287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.830733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:44.831270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:44.834373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:44.863530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 366/738] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:44.873573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:44.897721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced767b-f938-4165-9676-9a2d172a4dfb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:44.910335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:44.912347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:44.913160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:44.913945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:44.937851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:44.942042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:44.973930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:44.977053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 373/739] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:44.984490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.003206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117af43-1c65-4f5f-92c8-df86fada2e11 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.017468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.018178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.018457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.018724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.019492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:45.019792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.021449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.039524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 367/740] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:45.046112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.068094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872537dd-4a44-4103-bacf-c4f7c5c2e13f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.076007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.077486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.077979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.078524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.094701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.098793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.136163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:08:45.139157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 374/741] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:45.144940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.163394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffad80-97bc-46f2-8420-625964315be1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.178680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.179372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.179649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.179922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.180819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:45.181124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.182973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.212215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 368/742] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:45.219196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.241978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfe7-eee3-495c-9385-e5236c8e6373 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.249598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.251880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.252843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.253536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.269442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.273101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.291013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 375/743] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/auth/tokens => generated 1018 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:45.300499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.313822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d10a1-42c3-4de8-900e-43e06a7bfb5b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.333280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.334171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.334453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.334881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.353057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.354931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.386126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:45.387669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 369/744] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:45.394234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.419643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44da411-aedd-4ad9-8c0a-e668c508ae1e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.436037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.437734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.438544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.439324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.441027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:45.441998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.445625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.472186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 376/745] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:45.481376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.497761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94fb64-181b-46c7-9919-0779243bfe92 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.514748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.515581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.515844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.516172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.533747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.535727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.560189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:45.566435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 370/746] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:45.568590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.600830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624907-0832-48a9-ae97-8e5a05f48ff5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.618528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.619682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.620184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.620723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.622268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:45.622833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.626635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260b3a-f17b-476b-9e47-db2184014f34 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.662326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 377/747] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:45.668306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:45.685873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482e6b8-e99b-4418-9d93-50a18ba76097 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:45.697749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:45.698436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:45.698710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:45.698985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:45.699870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=8d53d9d39ed447fb8a0c725926dad501) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:45.700190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:45.702104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b514c-d3a6-4097-818b-19d978e6bd58 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:45.713217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 371/748] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:45 2021] GET /identity/v3/role_assignments?user.id=8d53d9d39ed447fb8a0c725926dad501&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:46.655925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec84d-0940-442c-8603-fa8c4b3f7f4b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.655925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec84d-0940-442c-8603-fa8c4b3f7f4b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.655925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec84d-0940-442c-8603-fa8c4b3f7f4b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.657489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 378/749] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:46.665152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634fd4-5520-48fc-9046-27d513ff0841 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.665662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634fd4-5520-48fc-9046-27d513ff0841 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.666051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634fd4-5520-48fc-9046-27d513ff0841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.704942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-53634fd4-5520-48fc-9046-27d513ff0841 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:46.706959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-53634fd4-5520-48fc-9046-27d513ff0841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:46.728957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 372/750] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:46 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:46.735040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b4b2-7073-4dcb-9a9d-5c63f67823ce None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.735912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b4b2-7073-4dcb-9a9d-5c63f67823ce None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.736388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b4b2-7073-4dcb-9a9d-5c63f67823ce None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.738752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 379/751] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:46.745699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.746186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.746672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.762749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8b4b2-7073-4dcb-9a9d-5c63f67823ce None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:46.770921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:46.772139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:46.788551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 373/752] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:46 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:46.795575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8b4b2-7073-4dcb-9a9d-5c63f67823ce None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:46.805496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:46.806757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.807201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.807659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.808687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:46.818051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b435f-f8e1-4fed-a195-49f159a2e7ca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:46.827893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:46.834943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:46.836615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 380/753] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:46.838220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:46.839050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.839426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.839808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.840739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:46.842455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:46.844779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:46.859234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ef82-fdd7-4731-b01f-488ba545fafe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:46.870215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 374/754] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:08:46 2021] POST /identity/v3/services => generated 240 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:46.893505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:46.894190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.894466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.894740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.895525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:46.895826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:46.897514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:46.908637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 381/755] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:46.914461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:46.937721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383ab40-88bd-4bec-aff9-3885d1caa15e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:46.946474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:46.947311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:46.947587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:46.947864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:46.963620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:46.965487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:46.989584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:46.990870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 375/756] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:46.997555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.013368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15563f-50cf-4546-9f5b-9cdfccdfa0ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.022875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.024085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.024653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.025125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.026136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.026657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.028700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.051352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 382/757] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.057737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.070606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c579c21-8aa1-424e-bf09-13e411f837c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.077532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.078348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.078708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.078947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.088076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.090326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.112267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:47.113575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 376/758] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:47.127097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.143689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861b10a-da3a-499c-a597-4967ec324b9b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.152862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.154103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.154569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.155158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.156381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.157171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.159895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.189271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 383/759] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.197683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.210696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af301-3564-4501-a8ba-4bdb23350772 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.222150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.223081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.223503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.223916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.235783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.237969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738656-5bc3-42de-b45d-b87ccddd844c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.248524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 377/760] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:47.260468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.271262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3b05-f73d-4b65-a772-e284f83d9ed4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.271543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3b05-f73d-4b65-a772-e284f83d9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.271821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3b05-f73d-4b65-a772-e284f83d9ed4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.273267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a4c2-dc4a-4104-8402-690b68ce25be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.273892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 378/761] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:47.280486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.280794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.281073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.284099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.285108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.286344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.286712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.299244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.301368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.306220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:47.307654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:47.319064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 379/762] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:47 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:47.323004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:47.324814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 384/763] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:47.331423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.341971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617f7f3-cf43-48bb-be18-d5389bdd03a3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.349546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.352108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.353056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.353503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.354008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.354990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.355520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.358435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.363207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6de56-a2ae-40af-a27c-5eaeeb9cd493 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.371190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.372373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.372808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.373254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.374183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.374580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 380/764] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.378559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.382542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.393451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e49b-6f11-410e-ab0c-7888e49c1984 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.393911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 16:08:47.395300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 385/765] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:47.398902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.399836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.400210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.407016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.408571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.426416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.429028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.431557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2bb5-de34-4682-a2e3-b6727847a78b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.444070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.445093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.445544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.446000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.447736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.448624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.453981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.462714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 386/766] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.469369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:47.471245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 381/767] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:47.477866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.489277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a3b45-a924-4c3e-b509-398e58fdf699 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.492844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.506157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198818-ac0f-4db9-b32d-3165f87b6faf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.511110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.512030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.513054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.513912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.515500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.516327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.518197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.520169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.521155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.521315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.521724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.524250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.524758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.529348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.542081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 382/768] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:47.553088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 387/769] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.560271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.571438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1968-bcbd-49eb-8b09-5f76c8a921a6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.575743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.590387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e754-c6c4-4b19-9838-741db151b157 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.593787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.595250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.596275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.597776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.604867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=a8dc448d7e48411eac14da58bb0fde06) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.605726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.611582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.612590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.613101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.614429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.620785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3655dc-aab0-4e70-ad60-3484918e4a83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.620956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] RBAC: Adding query filter params (interface=public, service_id=74e3ece558cf42e08730db5860005697, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.621396 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.623291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:47.623291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:47.623291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:47.623291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.633067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 383/770] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/role_assignments?user.id=a8dc448d7e48411eac14da58bb0fde06&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.635311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1e3e5-32af-467e-b356-310999ba9e86 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.635814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1e3e5-32af-467e-b356-310999ba9e86 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.636238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1e3e5-32af-467e-b356-310999ba9e86 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.638550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 384/771] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:47.648251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.648863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.649127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 388/772] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/endpoints?service_id=74e3ece558cf42e08730db5860005697&interface=public®ion_id=RegionOne => generated 194 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:47.649472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.657755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.677049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:47.678948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:47.682648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ee93-1807-4980-a4c4-47f878833c33 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.692965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.693966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.695035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.696568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 385/773] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:47 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:47.697130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.698024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.699942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.713807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 389/774] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/services => generated 772 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:47.744135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.754620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2d7d-5e9f-46b2-aeb4-438dfbf56038 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.765147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.766524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.767032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.767540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.790903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:47.798520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:47.800168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 386/775] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:47.811100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.826440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313985a-dd20-4930-8608-098b95f15f7f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.838494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.839657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.840161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.840717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.841786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:47.842324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.844647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.863887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 390/776] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:47.874490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:47.898825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff1b3-8fd3-4a66-abd1-40d7bd8b3a01 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:47.915955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:47.917966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:47.918867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:47.919640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:47.949357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:47.952864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:47.992919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:47.995681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 387/777] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:48.009458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.032649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc3cb-f95a-49a0-979e-9f224dad2134 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.040953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.041690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.041996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.042268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.043122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:48.043380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.045330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.061712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 391/778] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:48.071045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.087087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8723db-8300-41cc-9af3-cab0327f51a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.096185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.097052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.097337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.097638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.107625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.110033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.140033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:08:48.143129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 388/779] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:48.152017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.174044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038e716-5ba9-46b5-a136-980171368c9c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.182821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.183952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.184499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.184994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.186682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:48.187224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.191812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.244151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 392/780] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:48.257716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.285122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bf72-8f64-4075-a1ce-375e7bdec89d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.301667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.302744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.303226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.303701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.323041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.326362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.351868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 389/781] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:48.361455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.383751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528238e1-05d7-48b9-99d7-66c3146658ee admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.392222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.393214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.393529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.393809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.410627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.412574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.435523 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:48.437290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 393/782] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:48.446924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.473082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719291-9871-404c-b946-d188e0846a31 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.485780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.486667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.487152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.487632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.489042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:48.489578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.492751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.527364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 390/783] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:48.536410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.553153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d14c-c031-4a8f-bed9-73f489865dee admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.561289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.562170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.562643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.562944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.578172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.581010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.602112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:48.603751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 394/784] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:48.613793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.640262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf304f-4ce8-4007-8411-5c831e254f9e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.651605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.652666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.653135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.653594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.654945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:48.655460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.659417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d7e8b-5f2b-4b59-881d-b1ef22339a9c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.695467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 391/785] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:48.705221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:48.721730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbafdc-ab0f-4274-8ffd-d4e73accc401 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:48.730091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:48.730810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:48.731085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:48.731355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:48.732300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:48.732638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:48.734555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ac4e-8f16-4335-a509-56a0aa7216d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:48.745927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 395/786] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:48 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:49.389559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0c3-426a-4fb6-9fa3-77e7b770b2ae None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.390044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0c3-426a-4fb6-9fa3-77e7b770b2ae None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.390422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0c3-426a-4fb6-9fa3-77e7b770b2ae None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.394407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 392/787] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:49.400279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.400675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.400932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.425590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:49.428041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:49.446728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 396/788] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:49 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:49.473535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f0c3-426a-4fb6-9fa3-77e7b770b2ae None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.491275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f0c3-426a-4fb6-9fa3-77e7b770b2ae None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.498409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.499302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.499586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.499867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.512275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:49.520094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:49.521761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 393/789] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:49.528293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.538639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc502-6560-451a-9f44-4bbab023e0d8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.543441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.544132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.544411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.544708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.545479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:49.545782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.547510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.559131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 397/790] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:49.565780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.576848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a5d5-bdda-4a99-958b-1c03dc2b8356 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.581987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.582793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.583071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.583345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.596022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.597973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.617325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:49.618890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 394/791] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:49.625799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.656980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93f786-f7fe-445e-99a4-fd2cb3327bd5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.673804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.674972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.675412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.675847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.677094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:49.677618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.680831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.714971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 398/792] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:49.721345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.742758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a367d5-3e9c-4f5a-8318-1d1f7536ea28 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.753379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.754247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.754530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.754797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.769975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.772086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.792764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:08:49.794386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 395/793] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:49.801383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.812058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769637-0af3-4dc3-b09d-82ccad9ca989 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.817483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.818183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.818460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.818733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.819628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:49.819934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.821906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.851321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 399/794] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:49.859941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.876702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c6a-ef89-4050-b499-5b19fdf11ea0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.883881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.884802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.885088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.885365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.902626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.904653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:49.928845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:49.930342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 396/795] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:49.937205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:49.964268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08600f39-6aeb-4ea1-a879-d7256da16720 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:49.976858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:49.977945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:49.978341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:49.978724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:49.979825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:49.980261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:49.982770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:50.021349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 400/796] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:50.027334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:50.045650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee4d0f-1f3c-4b57-a75c-d97a69c5073e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:50.059495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:50.060844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:50.061340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:50.061834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:50.073060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:50.075108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:50.093930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:50.095782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 397/797] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:50.102960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:50.134945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799113a8-86cd-4d14-a6d0-70babc11f9ac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:50.151739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:50.152887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:50.153393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:50.153840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:50.155290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:50.155802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:50.159274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237400d6-8184-4ad4-9a01-4d3c1d752760 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:50.186445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 401/798] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:50.193602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:50.212226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387deaa-6852-4a2e-8160-01f7060c4507 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:50.218937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:50.220470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:50.220743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:50.221034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/8d53d9d39ed447fb8a0c725926dad501/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:50.249390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=8d53d9d39ed447fb8a0c725926dad501, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:50.257986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a66e-e820-47fa-81c0-f8c6ede3cec1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:50.294826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 398/799] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:50 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/8d53d9d39ed447fb8a0c725926dad501/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:08:50.954094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671ce00-8b6c-44e4-8521-a757c97a24ad None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:50.954817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671ce00-8b6c-44e4-8521-a757c97a24ad None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:50.955070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671ce00-8b6c-44e4-8521-a757c97a24ad None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:50.958979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 402/800] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:50 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:50.969809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:50.970481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:50.970773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.018332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:51.020133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:51.155785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 399/801] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:50 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:51.213468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671ce00-8b6c-44e4-8521-a757c97a24ad None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.241564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671ce00-8b6c-44e4-8521-a757c97a24ad None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.253727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.254917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.255345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.255766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.256866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.259602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.283552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 16:08:51.289746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 403/802] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services/network => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:51.299831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.319589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994118ff-65b6-4c1d-a9f1-cfa85e9eff54 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.330894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.331881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.332285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.332725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.333981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:51.334519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.337608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.346746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 400/803] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:51.356840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.377017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2f0e-6e5e-4677-9dda-a56c1ebde14f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.386940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.388032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.388535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.389013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.390332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:51.390872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.394371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.409109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 404/804] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services?type=network => generated 350 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:51.419820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.440315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f31a0f-a138-44ab-bf1f-720d8ad86501 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.455390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.456569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.457000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.457457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.458910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] RBAC: Adding query filter params (interface=public, service_id=84c6d824b7724060a702753ad348067d, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:51.459437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.461311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:51.461311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:51.461311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:51.462940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dfec7-5d82-4727-bb7c-b3dba0c0e0fa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.480181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 401/805] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/endpoints?service_id=84c6d824b7724060a702753ad348067d&interface=public®ion_id=RegionOne => generated 194 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:51.490147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.509845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2246063-83bd-465a-9770-8f290656c1d5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.523315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.524498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.524977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.525437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.526711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.529639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d46dd8-4f53-4858-b38f-94e432e7faf3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.545012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 405/806] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services => generated 772 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:51.659996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312a68-68f6-41e2-be14-cce7fb19df54 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.660558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312a68-68f6-41e2-be14-cce7fb19df54 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.661076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312a68-68f6-41e2-be14-cce7fb19df54 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.664846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 402/807] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:51.672112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749f5-d22d-4dfe-b92d-efde9d038d65 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.672802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749f5-d22d-4dfe-b92d-efde9d038d65 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.673205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749f5-d22d-4dfe-b92d-efde9d038d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.716735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-200749f5-d22d-4dfe-b92d-efde9d038d65 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:51.719143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-200749f5-d22d-4dfe-b92d-efde9d038d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:51.740253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 406/808] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:51 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:51.776833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312a68-68f6-41e2-be14-cce7fb19df54 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.809871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312a68-68f6-41e2-be14-cce7fb19df54 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.817550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.818978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.819489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.819983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.828267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcc20-8baa-43e0-8a43-f5380f1d1b8b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.828267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcc20-8baa-43e0-8a43-f5380f1d1b8b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.828267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcc20-8baa-43e0-8a43-f5380f1d1b8b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.828267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 407/809] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:51.837672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.837672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.837672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.856504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:51.869027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:51.870013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:51.871249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:51.872508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 403/810] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:51.879906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.898348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 408/811] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:51 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:51.898828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458323-4d53-44ad-9cfc-57c077fbc4a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.906971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.908701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.909590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.910345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.912116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:51.913019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.916598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.929656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.935734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 404/812] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:51.944676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:51.953434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af94c54-efc6-4c2b-8413-314b052d6323 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.963613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.964729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.964868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.965155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.965714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:51.967330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:51.970467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea4d9-2c86-418b-befb-f2c562e91878 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:51.979965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 16:08:51.981400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:51.981599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 409/813] 10.222.0.30 () {56 vars in 1150 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:51.982256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:51.982540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:51.982817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:51.994045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.005543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.007354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c092-0078-4bff-8c09-cf4b4dcefc80 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.009499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.018201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.019350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.019833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.020343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.021383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.021952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.023949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.031565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 410/814] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:52.041205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.052349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:52.053177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bc04-4027-4ac1-a804-6ff27e6b5d53 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.059804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 405/815] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:52.061610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.061926 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.063639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.064163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.065852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.067262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.067822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.072256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.075009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210d38d-8e7d-48a6-991f-dcb287396d42 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.084994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.086116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.086794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 411/816] 10.222.0.30 () {56 vars in 1145 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:52.087240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.087719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.088886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.089444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.091404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.098106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.107371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 406/817] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:52.116839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.131768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6640-ef25-4963-8c00-485f3e008179 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.144321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.145504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.146004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.146497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.147935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.149879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:52.149879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:08:52.149879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:08:52.151584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.156381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082367c-c015-45b9-a367-29a51e609396 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.165759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.167150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.167650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.168144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.197827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.202062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.219790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 412/818] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:08:52 2021] POST /identity/v3/endpoints => generated 346 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:08:52.234701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:52.237093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 407/819] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/users/swift => generated 83 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:52.243707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.274199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2e0a-3d32-4c85-991e-361fcbbf7c18 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.281928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.283037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.283512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.283978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.285164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.285690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.288003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.316079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 413/820] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:52.323493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.334587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7a07-218f-4a74-962b-800dd2924bdf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.345661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.346915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.347432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.347896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.362017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.364252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.393049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-cb3d1988-fa98-4c69-b7eb-28df308fda9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:52.394658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 408/821] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:52.402057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.432664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1ed0-8ac0-4dbd-b087-135e5261b27b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.440405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.441568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.442069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.442558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.443925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.452506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.456019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.459663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676dea-44f9-4b0f-b3c7-3adbe1d5924a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.460171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676dea-44f9-4b0f-b3c7-3adbe1d5924a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.460705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676dea-44f9-4b0f-b3c7-3adbe1d5924a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.462701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 409/822] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:08:52.469631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.470225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.470757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.491681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 414/823] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:52.494659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.496380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:52.497891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:52.506804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 410/824] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:52 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:52.513999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521a8a-71eb-43d2-84c2-b7d488c85a97 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.521561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.522963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.523426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.523880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.532280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.537108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.540721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.542930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5e25-be2a-46de-a03b-243099df154b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.548670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.549972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.550490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.550960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.551892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.553141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:52.553141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:52.553141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:52.554478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.568302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:52.569302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 16:08:52.570738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 415/825] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:52.571074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 411/826] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:52.578744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.582078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.597965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974020-b7bb-495a-b7f6-c49a9b184634 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.601334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7a2-20ee-4fcb-8f73-c6866dc89cde admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.606830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.607957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.608504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.608967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.609584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.610334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.610724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.611075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.611175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.611657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.613193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.613486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.613748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.619493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.628621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 416/827] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:52.636881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.640449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 412/828] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:52.652415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.659456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029fb83-f258-44c8-bae9-7d4296c63a6a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.670673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc108-4bea-4c88-94de-944b02545b9d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.678750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.678957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.679438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.679775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.680051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.680548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.680845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:52.681024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.681136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.681474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/a8dc448d7e48411eac14da58bb0fde06/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.683398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5de16-a63d-416e-af44-85ec869850a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.686031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=a8dc448d7e48411eac14da58bb0fde06, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.692798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc74e-640b-493c-ab52-674753e38764 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.693707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 417/829] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:52.721818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 413/830] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:08:52 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/a8dc448d7e48411eac14da58bb0fde06/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:53.269166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c358c6-e409-4843-9edd-b7d2d3b31da1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.269698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c358c6-e409-4843-9edd-b7d2d3b31da1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.270115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c358c6-e409-4843-9edd-b7d2d3b31da1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.274031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 418/831] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:53.283530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.284069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.284542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.329143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:53.331274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:53.470648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 414/832] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:53 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:53.533218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c358c6-e409-4843-9edd-b7d2d3b31da1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.558375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c358c6-e409-4843-9edd-b7d2d3b31da1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.566612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.568011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.572553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.573068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.596676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:53.613141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:08:53.615444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 419/833] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:53.625899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.649230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9725f0-db09-43bd-92c7-23ae6e810150 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.666974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.668110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.668628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.669113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.670468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:53.670985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:53.674102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:53.698550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 415/834] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:53.708737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.738857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05a0c-4ea9-4b59-bf70-42df821d0d19 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.746766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.748203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.748726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.749282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.770625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:53.774358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:53.808032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:53.810748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 420/835] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:53.821105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.852584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320766-e8f8-4e05-8137-975dce29a9c7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.867148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.868299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.868821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.869304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.870691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:53.871232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:53.874344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:53.910155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 416/836] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:53.920575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.953463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea3d-96a9-4602-898f-bce31c9b0406 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.962756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.964613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.965112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.965598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.989616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:53.993540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.025293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:08:54.027927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 421/837] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:54.038062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.072421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb012ee-6d78-4707-a748-3c110d2b3f27 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.089694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.090849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.091337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.091827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.093520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:54.094874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.098512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.155171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 417/838] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:54.166127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.197098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feccf-9431-4ced-aa76-10628f1dcb9d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.206671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.213545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.214190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.214708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.242668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.246217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.271379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 422/839] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:54.281993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.317030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a879349-8ffc-463a-afe5-f4cc3bfa1ff3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.331920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.333296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.333780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.334258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.368383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.372055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.416955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:54.419708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 418/840] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:54.430397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.454525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25cc9-7aa3-4325-b051-ec0ef319e0f7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.469182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.470336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.470826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.471301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.472781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:54.473399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.485369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.513471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 423/841] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:54.523416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.556555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00f34-5138-4354-91ea-cf31c12ca1ab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.570549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.571884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.572363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.572898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.594779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.598581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.636070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:54.638697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 419/842] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:54.648920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.659819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb9607-97b0-4ecb-b14b-18ed47e570cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.673317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.674070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.674352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.674624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.675487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:54.675799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.677765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b869-35db-41a4-8b76-f121a3739a35 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.691992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 424/843] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:54.702699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:54.733561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af691f4-901c-4007-8481-5581e118e92b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:54.751369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:54.752532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:54.753029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:54.753473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:54.755131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=8d53d9d39ed447fb8a0c725926dad501) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:54.755699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:54.759392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1c537-acb5-4e8f-a463-e069791ce9ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:54.777301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 420/844] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:54 2021] GET /identity/v3/role_assignments?user.id=8d53d9d39ed447fb8a0c725926dad501&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:55.536757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d23c1-d7d4-46a6-8bb9-3a7f8d0706b0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.537267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d23c1-d7d4-46a6-8bb9-3a7f8d0706b0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.537267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d23c1-d7d4-46a6-8bb9-3a7f8d0706b0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.539436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 425/845] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:55.546096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.546622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.546622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.572872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:55.574090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:55.587671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 421/846] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:55 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:55.618452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d23c1-d7d4-46a6-8bb9-3a7f8d0706b0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:55.633904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d23c1-d7d4-46a6-8bb9-3a7f8d0706b0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:55.640236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:55.641214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.641663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.642011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.642688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:55.644323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:55.660158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 16:08:55.661748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 426/847] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:55 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:55.668157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:55.679243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7959-d80a-4908-96d4-0dbdb9d8b528 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:55.686038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:55.686722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.687000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.687274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.688119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:55.689137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:55.690768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:55.698911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 422/848] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:55 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:55.705536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:55.716353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e09d35-cb61-4aa5-857c-01bdfd908f07 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:55.722075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:55.722814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.723083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.723354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.724196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:55.724550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:55.726222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497b6f-1062-4d90-b4df-7919eaf05d9a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:55.733451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 427/849] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:08:55 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:55.742309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:55.753725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c66a-ca02-4e1b-a33f-cd50d0edaa6c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:55.758859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:55.759572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:55.759853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:55.760126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:55.761042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:55.762070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:55.762070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:08:55.762070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:08:55.763008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8feb15-7a19-4777-a4d1-1fdf7dbfee83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:55.790256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 423/850] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:08:55 2021] POST /identity/v3/endpoints => generated 327 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:56.228149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784132b-f99e-48e8-85a6-e36e230e90f4 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.228600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784132b-f99e-48e8-85a6-e36e230e90f4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.228768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784132b-f99e-48e8-85a6-e36e230e90f4 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.230912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 428/851] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:56.238496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.238811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.239035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.260051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cdb8-f823-4205-a6db-f00927213fe5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.260051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cdb8-f823-4205-a6db-f00927213fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.260051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cdb8-f823-4205-a6db-f00927213fe5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.261929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 429/852] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:56.262344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:56.263581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:56.271914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.272174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.272499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.295692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:56.296983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:56.321079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 424/853] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:56 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:56.330659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 430/854] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:56 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:56.347525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.363378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d908ccb-a4e4-4f9e-a21d-5ccacae70cf4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.374508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.375610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.376120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.376788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.377979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.380504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.384612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.399142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d85cd-8d3e-4755-a673-50d067a4bea9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.409839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 425/855] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:08:56 2021] POST /identity/v3/services => generated 269 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:08:56.432123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.433596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.434162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.434623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.436071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.439668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.462545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 16:08:56.464784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 431/856] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:56.476216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.494604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d921b-59e7-4953-914f-f9c3aea23cf7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.503420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.504751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.505247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.505726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.507141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:56.507675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.510712 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c52941-9a3d-4417-b8c9-41dc9d33ab32 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.524621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 426/857] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:56.531141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.549667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192986-ba82-44a2-a54b-35432fd62c96 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.557397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.558616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.559066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.559508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.560825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:56.561312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.564341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d301-d1b3-4ebb-8532-afe1e8674f96 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.573249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 432/858] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:56.600485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1209-ecb8-4afe-a3ec-4c1951b27296 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.601024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1209-ecb8-4afe-a3ec-4c1951b27296 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.601472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1209-ecb8-4afe-a3ec-4c1951b27296 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.605501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 427/859] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:56 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:56.612738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.613274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.613715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.634804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:56.636395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:56.646248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 433/860] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:56 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:56.673317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1209-ecb8-4afe-a3ec-4c1951b27296 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.691385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1209-ecb8-4afe-a3ec-4c1951b27296 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.696713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.697938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.698427 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.698850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.713404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:56.721865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:08:56.723803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 428/861] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:56.730700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.741720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1364b3c-60ec-4d4f-8ac4-c219f776c1c9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.746958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.748004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.748483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.748904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.749872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:56.750332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.753036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.763234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 434/862] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:56.771065 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.783875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677bce6-6de6-4f38-89dd-8930a0df6de9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.789406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.790564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.791005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.791417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.805140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.807249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.827802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:56.830191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 429/863] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:56.836768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.848636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d9a-b16a-428a-9914-e2591cb4a474 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.855218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.856468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.857182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.857798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.858711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:56.859271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.862880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.879397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 435/864] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:56.885928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.896503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de1ba-787f-433a-b940-86d4d8576165 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.901196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.902052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.902374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.902641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.911298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.913366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.939354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 16:08:56.941993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 430/865] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:56.947954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:56.963096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6554d-a3df-42c7-a818-19eaf645ccdd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:56.968097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:56.969629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:56.970256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:56.970814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:56.971885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:56.972388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:56.974504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:56.995348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 436/866] 10.222.0.30 () {56 vars in 1156 bytes} [Wed Dec 15 16:08:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:57.003021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.014261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e98f-ceec-49b2-b828-ca6de337a4d6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.019440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.020422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.020964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.021417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.036482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.036482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.053546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 431/867] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:08:57.060026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.070626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d775-f1f9-4423-80f1-78408e8eb421 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.075509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.076697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.077229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.077694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.089572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.092188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.111673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:57.118707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 437/868] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:57.120542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.131439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5c5c-85aa-4e1e-a5dd-6c7d8b585848 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.136273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.137239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.137714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.138193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.139191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:57.139695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.141811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.162690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 432/869] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:57.164553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.175945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add3fd3-2f7f-49ad-b9e5-44ee9bda4bcf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.180974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.182060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.182539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.183000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.191603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.194321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.209049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:57.216369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 438/870] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:57.218177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.229668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e15df-db62-49ab-82f7-419ca32832a6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.234798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.236022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.236608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.237077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.238139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:57.238654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.240844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e2906-947b-428b-8b62-6150c36eb288 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.260737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 433/871] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:57.262956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:57.274254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9963879-0053-463f-84c7-f4272fc5fb4d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:57.279274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:57.280216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:57.280714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:57.281199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:57.282373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=a8dc448d7e48411eac14da58bb0fde06) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:57.282944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:57.285090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197ea94-c171-4099-8e10-e72ae16b7797 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:57.296737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 439/872] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:57 2021] GET /identity/v3/role_assignments?user.id=a8dc448d7e48411eac14da58bb0fde06&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:58.284308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f853-cec0-4171-b289-68bdc33f7190 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.285424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f853-cec0-4171-b289-68bdc33f7190 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.285992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f853-cec0-4171-b289-68bdc33f7190 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.288667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 434/873] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:58.296062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.297100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.297815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.316926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:58.318657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:58.332559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 440/874] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:58 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:58.352069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33f853-cec0-4171-b289-68bdc33f7190 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.365167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33f853-cec0-4171-b289-68bdc33f7190 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.369820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.370920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.371430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.371900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.383856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:08:58.392159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:08:58.398745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 435/875] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:58.401452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.411221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db15b-208c-4064-823c-d8e13d23cbb0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.416071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.417110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.417585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.418089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.419063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.419562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.421455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.436588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 441/876] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:58.439413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.450081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa780a-450a-4fb8-b828-2df6e4a207f4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.455263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.456694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.457187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.457652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.477823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.480123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.499612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:58.506447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 436/877] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:58.508240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.519189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c288-3be6-4091-bf67-856f467f1d71 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.524168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.525207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.525679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.526145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.527103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.527616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.529499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.548594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 442/878] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:58.551356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.562604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630360-4044-444e-9336-68ba4b859b02 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.567767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.568999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.569516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.569995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.579448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.581921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.598386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:08:58.605093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 437/879] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:58.607694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.618633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115480-6038-4673-b4cf-6788e1efeb3b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.623767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.624868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.625353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.625872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.627050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.627644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.629903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.654843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 443/880] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:58.658251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.669059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b079e0f-3a0a-4271-bc4d-6a7d7477be69 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.674412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.675581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.676090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.676618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.686005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.688247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.704634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 438/881] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:08:58.706434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.717154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bddbe1-2ca4-47ec-965c-38ba89cbc2c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.722543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.723748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.724245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.724786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.737393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.739700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.759525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:08:58.766354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 444/882] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:08:58.768132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.777733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712c3d-a42d-4cc9-8160-a4c2688c9d92 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.782821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.783901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.784407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.784909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.785849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.786416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.788228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.808120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 439/883] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:58.809874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.820896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51d028-359c-45e4-89c3-a6db375084b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.826196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.827459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.827942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.828458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.837282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.839686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.854421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:08:58.860549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 445/884] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:58.863228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.873903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f225-7001-430e-bb24-7355dcd1ceda admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.879612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.880826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.881324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.881840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.882913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.883479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.885736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fb9d6-5c32-483f-82b1-626edaf7c36b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.904613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 440/885] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:08:58.908138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.920276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2613a2-5914-4b1b-87b2-5af9c423d278 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.925843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.926926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.927402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.927874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.929025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] RBAC: Adding query filter params (role.id=71e0cefe69df4df08ecbbcbe51454429, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=8d53d9d39ed447fb8a0c725926dad501) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:08:58.929536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.931661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d916-85b3-4327-9065-188f247a1aa8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.944621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 446/886] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/role_assignments?user.id=8d53d9d39ed447fb8a0c725926dad501&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=71e0cefe69df4df08ecbbcbe51454429 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:59.314505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917395-deba-4c0b-a532-ee938ba16cb4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.315052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917395-deba-4c0b-a532-ee938ba16cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.315052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917395-deba-4c0b-a532-ee938ba16cb4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.317000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 441/887] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:59.323525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260612-9c15-41b0-8b90-494663ef4042 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.324578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260612-9c15-41b0-8b90-494663ef4042 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.325068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260612-9c15-41b0-8b90-494663ef4042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.345940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2f260612-9c15-41b0-8b90-494663ef4042 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:59.347567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2f260612-9c15-41b0-8b90-494663ef4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:59.355834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 447/888] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:59 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:59.380702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8917395-deba-4c0b-a532-ee938ba16cb4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:59.393945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8917395-deba-4c0b-a532-ee938ba16cb4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:59.398695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:59.399412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.399686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.399956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.400848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:59.402514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84918e4-2ab6-4810-bdaa-c9a287cbaa02 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:59.422309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 442/889] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:08:59 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:08:59.886382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4b84-a749-4b8a-9c9f-e8c9843ffbb3 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.886730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4b84-a749-4b8a-9c9f-e8c9843ffbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.886922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4b84-a749-4b8a-9c9f-e8c9843ffbb3 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.889630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 448/890] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:59.897802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d9e4-5323-4e0e-853a-613e3597b831 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.897802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d9e4-5323-4e0e-853a-613e3597b831 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.897802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d9e4-5323-4e0e-853a-613e3597b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.916620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e574d9e4-5323-4e0e-853a-613e3597b831 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:59.917803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e574d9e4-5323-4e0e-853a-613e3597b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:59.936097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 443/891] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:08:59 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:59.960386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4b84-a749-4b8a-9c9f-e8c9843ffbb3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:59.974450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4b84-a749-4b8a-9c9f-e8c9843ffbb3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:59.978859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:59.979670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.979951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.980226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:59.980954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:59.982563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:59.995658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 16:08:59.997149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 449/892] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:08:59 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:08:59.998325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9335d8-dda6-4c0d-887c-b906d60de5b4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:59.998834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9335d8-dda6-4c0d-887c-b906d60de5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:59.999339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9335d8-dda6-4c0d-887c-b906d60de5b4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.004492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.014616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ddfa4-850b-4404-91c5-48b9de34e99c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.017215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 444/893] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:08:59 2021] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:00.020053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.020808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.021089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.021362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.022084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089112-45ca-4646-95e2-33d088403703 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.022270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:00.022426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.022581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089112-45ca-4646-95e2-33d088403703 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.023056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089112-45ca-4646-95e2-33d088403703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.024033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.030005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 450/894] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:00.037087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.046885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23381abb-3c7e-46a6-a3bf-602aa1aef9b7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.052406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.053102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.053383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.053653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.054368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:00.054668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.056245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.056400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-28089112-45ca-4646-95e2-33d088403703 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:00.058616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28089112-45ca-4646-95e2-33d088403703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:00.061635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 451/895] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:00.074349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 445/896] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:00 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:00.127411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.146268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f1dc-287a-41f9-bd73-6d9816d9e97c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.154481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.156022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.156678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.157248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.158649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.161998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.184728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 16:09:00.187479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 452/897] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:00.199160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089112-45ca-4646-95e2-33d088403703 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.216585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089112-45ca-4646-95e2-33d088403703 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.224978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.226180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.226690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.227165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.228581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:00.229114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.232246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.242297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 446/898] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:00.253938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.272399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d4d20-a01f-447a-adc3-f1aa0278f776 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.280364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.281631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.282203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.282705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.284350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:00.284985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.288108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.304690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 453/899] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:00.311872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.330331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132394-ed55-4e3a-936d-931abf022b29 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.338634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.339203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.339746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.340237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.341873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] RBAC: Adding query filter params (interface=public, service_id=6d50823950744e4a94af7e0d8b637e09, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:00.342503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.346163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3025b-bb9b-40e9-aba2-3803c3bd7ecc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.356144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 447/900] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/endpoints?service_id=6d50823950744e4a94af7e0d8b637e09&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:00.366645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.384765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ce6b1-cecd-4f05-8de6-2bcc337e100b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.393018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.394190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.394731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.395223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.396665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.399739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63070156-f316-4a74-89c4-409414c5a865 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.412215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 454/901] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/services => generated 1268 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:09:01.443153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7f96-f0ee-4136-a9f1-354848ffbf42 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.443659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7f96-f0ee-4136-a9f1-354848ffbf42 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.443659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7f96-f0ee-4136-a9f1-354848ffbf42 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.445775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 448/902] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:01.452187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.453152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.453617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.474107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:01.476612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:01.492587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 455/903] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:01 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:01.511042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c7f96-f0ee-4136-a9f1-354848ffbf42 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.525015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c7f96-f0ee-4136-a9f1-354848ffbf42 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.529956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.531137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.531611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.532204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.544656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:01.552472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:09:01.559622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 449/904] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:01.561402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.571666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16b6a-3267-4da8-9034-616b4a88ef72 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.577209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.578351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.578933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.579423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.580457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:01.580975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.582884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.599234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 456/905] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:01.601086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.612348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a14a65-2e56-4676-95c0-e69421b0994d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.617779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.619022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.619525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.620060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.632285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.634539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.653344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:01.659315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 450/906] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:01.662313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.673326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7323-d32d-44a3-b95f-4e1277d0b205 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.678484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.679510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.679996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.680486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.681429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:01.681924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.683746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.702531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 457/907] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:01.706036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.716619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcb161-2ec0-4dae-8d8a-ec48e3f39a40 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.722601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.723776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.724285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.724796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.733807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.736740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.752904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:09:01.754484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 451/908] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:01.761839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.772365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012c478-9265-4d17-96df-1513ec9d8d49 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.777502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.778558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.779079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.779540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.780658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:01.781156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.783594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.808627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 458/909] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:01.811025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.823687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a95eb-045d-4a10-9153-f7caded499b6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.829404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.830684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.831163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.831672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.848520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.851876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.885693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:01.888076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 452/910] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:01.894452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.905117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94347308-658e-4c10-ba0f-55dd67e633a9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.910353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102371-1859-4204-92a5-319702c9668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.911372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102371-1859-4204-92a5-319702c9668c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.911858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102371-1859-4204-92a5-319702c9668c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.912326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102371-1859-4204-92a5-319702c9668c admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.913326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102371-1859-4204-92a5-319702c9668c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:01.913840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102371-1859-4204-92a5-319702c9668c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.915651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102371-1859-4204-92a5-319702c9668c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:01.934306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 459/911] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:01.936638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:01.956191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55504f-09c5-4e84-b4ac-e2a799e62d4d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:01.964244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:01.965937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:01.966487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:01.966959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:01.982294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:01.987384 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.013034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:02.015690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 453/912] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:02.022667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102371-1859-4204-92a5-319702c9668c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.033645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102371-1859-4204-92a5-319702c9668c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.038643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.039882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.040356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.040848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.041834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:02.042339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.044369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db799c0-b8bc-48a5-abbf-a423fc5ea962 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.063740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 460/913] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:02.066109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.078799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7e3f1-4705-40f0-b5f8-3f4346229025 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.083887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.085169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.085679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.086146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/8d53d9d39ed447fb8a0c725926dad501/roles/71e0cefe69df4df08ecbbcbe51454429` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.088842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=8d53d9d39ed447fb8a0c725926dad501, role_id=71e0cefe69df4df08ecbbcbe51454429)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.092825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0edab-3f62-4813-b7ad-d7e151373532 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.093356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0edab-3f62-4813-b7ad-d7e151373532 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.093867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0edab-3f62-4813-b7ad-d7e151373532 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.094506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.097304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 461/914] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:02.107726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.108163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.108674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.128085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 454/915] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:09:02 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/8d53d9d39ed447fb8a0c725926dad501/roles/71e0cefe69df4df08ecbbcbe51454429 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:09:02.137133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:02.140068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:02.264025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 462/916] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:02 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:02.292303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.312824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c35-507b-41fe-b67a-d7d2a51ea315 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.322245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.324058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.324879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.325599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.327147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.331643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.356078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 16:09:02.359322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 455/917] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:02.365793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.375430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7491fe5-cbcd-4f54-9306-859f57507b27 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.380317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.381040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.381317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.381584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.382308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:02.382607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.384346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.390100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 463/918] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:02.397435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.416237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ec89-b839-4ba2-ae12-3080e04c3af6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.424650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.426185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.426874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.427547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.429012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:02.429814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.432788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.446347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 456/919] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:02.453586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.476838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e6e36-dd0e-4bb3-843a-46a659c459cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.484297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.485406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.485887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.486362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.487868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] RBAC: Adding query filter params (interface=public, service_id=49bc577c7f5e4bfaa8c711a853666dd8, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:02.488416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.491346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee874-d60e-4640-83fb-a2876ca6de3b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.508601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 464/920] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/endpoints?service_id=49bc577c7f5e4bfaa8c711a853666dd8&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:02.512303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.530282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791d3f-dd08-416d-af11-7e62fe9ec41d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.538306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.539434 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.539915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.540373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.543021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.544640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b788-615a-4f9b-b369-c3e23797fcce None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.544815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.545151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b788-615a-4f9b-b369-c3e23797fcce None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.545622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b788-615a-4f9b-b369-c3e23797fcce None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.550116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 465/921] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:02.551604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 457/922] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:02 2021] GET /identity/v3/services => generated 1268 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:09:02.558957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff026-5379-409a-a3b5-6a83a897a381 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.559453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff026-5379-409a-a3b5-6a83a897a381 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.559932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff026-5379-409a-a3b5-6a83a897a381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.593666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3f8ff026-5379-409a-a3b5-6a83a897a381 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:02.596873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3f8ff026-5379-409a-a3b5-6a83a897a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:02.611683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 466/923] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:02 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:02.636533 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:02.647064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556439-6538-4290-8b21-33265ead31db admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:02.652382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:02.653237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:02.653524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:02.653853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:02.654623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:02.656544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575c77-dead-4c24-b416-b0ce200db3b5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:02.677260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 458/924] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:09:02 2021] POST /identity/v3/services => generated 241 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:03.745229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fd3-6703-4722-bfe9-cb7fda48ce45 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.745988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fd3-6703-4722-bfe9-cb7fda48ce45 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.745988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fd3-6703-4722-bfe9-cb7fda48ce45 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.747939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 467/925] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:03.754535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.755400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.755400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.774110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:03.775304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:03.793045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 459/926] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:03 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:03.817855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638fd3-6703-4722-bfe9-cb7fda48ce45 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:03.831404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638fd3-6703-4722-bfe9-cb7fda48ce45 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:03.835711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:03.836556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.836830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.837093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.837765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:03.839353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:03.852155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 16:09:03.853776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 468/927] 10.222.0.30 () {56 vars in 1153 bytes} [Wed Dec 15 16:09:03 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:03.860287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:03.870025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eee37-ed2b-4b8a-bdbb-75110ec5d83b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:03.874576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:03.875245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.875527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.875997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.877197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:03.877503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:03.879110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:03.884327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 460/928] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:03 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:03.890612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:03.901534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc458888-9e84-455f-9ae5-ec6f8b001e72 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:03.906163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:03.906947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.907266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.907748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.908653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:03.908959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:03.910556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7e2b-bb02-4466-a8d1-86f6e4502798 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:03.916331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 469/929] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:03 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:03.922977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:03.933147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085998-a4ad-4060-82f7-f1a0a68790f9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:03.937799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:03.938722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:03.939209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:03.939581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:03.940371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:03.942044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63dbc8-2fcb-4334-bb65-0db562ed54db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:03.964979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 461/930] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:03 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:04.765763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717bcc-a4f4-4666-b15c-23a5a680ae47 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.766828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717bcc-a4f4-4666-b15c-23a5a680ae47 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.766828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717bcc-a4f4-4666-b15c-23a5a680ae47 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.768944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 470/931] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:04.775266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120316-27d1-4eef-978d-de4b58302deb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.776215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120316-27d1-4eef-978d-de4b58302deb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.776761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120316-27d1-4eef-978d-de4b58302deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.795494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-16120316-27d1-4eef-978d-de4b58302deb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:04.797099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-16120316-27d1-4eef-978d-de4b58302deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:04.817116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 462/932] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:04 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:04.841991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717bcc-a4f4-4666-b15c-23a5a680ae47 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:04.855548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717bcc-a4f4-4666-b15c-23a5a680ae47 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:04.860535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:04.861696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.862202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.862673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.875119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:04.882977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:09:04.890008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 471/933] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:09:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:04.892509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120316-27d1-4eef-978d-de4b58302deb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:04.902141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120316-27d1-4eef-978d-de4b58302deb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:04.906805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:04.908413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.908752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.909031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.909850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:04.910160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:04.911852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:04.922054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 463/934] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:04.929539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:04.940757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019dc9c-22f0-4b41-9837-52234e35b33f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:04.946000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:04.947194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.947695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.948171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.960781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:04.963007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:04.982619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:04.988783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 472/935] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:04.991700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.009366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0309-2276-4a97-a464-9cb32551bcac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.014866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.015996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.017361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.017946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.018982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.019501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.021447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.036804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 464/936] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:05.043035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.054320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2bff1-fe43-43e0-a9ab-ab5ea43e3c53 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.059511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.060744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.061319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.061799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.070942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.073412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.089426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 16:09:05.096585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 473/937] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:05.098731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.109583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691025bd-c966-4991-80fb-0088c16d5f1f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.114827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.115873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.116376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.116880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.118001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.118534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.120676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.152638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 465/938] 10.222.0.30 () {56 vars in 1170 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:05.156565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.168408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4445-c919-4ad7-bf4f-9997c81c0450 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.173692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.174405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.174682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.175001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.184297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.186163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.200938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 474/939] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:05.203276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.213663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703529-1ae2-4e5f-8044-1f60b2aee0f7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.218382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.219538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.219993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.220644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.231703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.233626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.252528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:05.258110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 466/940] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:05.261486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.271597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e534a-62b5-4934-90cf-b64762b20666 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.276625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.277297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.277625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.277921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.278703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.279008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.280619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.299683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 475/941] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:05.301106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.311121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b8a1-ac7a-4dbd-97c1-c8b841357e40 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.315951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.316776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.317050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.317397 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.325048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.327030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.344890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:05.348244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 467/942] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:05.349739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.363061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b127269-82ee-4c32-b989-1a55cb2342d1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.367800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.368564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.368846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.369119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.370016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.370320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.372295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f70b21-0000-4c47-9c18-292afb72030a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.388567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 476/943] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:05.394948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.407329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db3f9-0475-48df-95ad-5aa47c403860 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.412652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.413581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.414068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.414571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.415606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] RBAC: Adding query filter params (role.id=71e0cefe69df4df08ecbbcbe51454429, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=8d53d9d39ed447fb8a0c725926dad501) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.416142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.418317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1d068-8d90-4841-ad06-1c13109a3a98 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.426137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 468/944] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/role_assignments?user.id=8d53d9d39ed447fb8a0c725926dad501&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=71e0cefe69df4df08ecbbcbe51454429 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:05.563981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce88e4-470f-4990-a916-ecddbce0d103 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.564267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce88e4-470f-4990-a916-ecddbce0d103 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.564728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce88e4-470f-4990-a916-ecddbce0d103 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.567150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 477/945] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:05.574130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.574790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.575546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.594566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:05.596272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:05.608585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 469/946] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:05 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:05.629312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce88e4-470f-4990-a916-ecddbce0d103 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.642774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce88e4-470f-4990-a916-ecddbce0d103 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.647630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.648929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.649435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.649896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.650758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.652686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.665001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 16:09:05.672036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 478/947] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:05.673995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.683964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0e75-8403-480b-960f-75172ef6622a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.689135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.690132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.690644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.691107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.692028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.692562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.694374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.700980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 470/948] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:05.707989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.720048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1818fab-b5d4-4973-a380-c2becb8d06de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.724728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.725398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.725810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.726083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.726812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.727119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.728744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.734452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 479/949] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:05.742125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.756085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1bea-dedb-403d-bdf8-cce58a391c72 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.760983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.761944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.762431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.762899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.763925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] RBAC: Adding query filter params (interface=public, service_id=d55dac05e5814366a7643f2e65cc8924, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:05.764552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.766470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956881d-b2c3-42f5-848a-e0c164640194 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.776567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 471/950] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/endpoints?service_id=d55dac05e5814366a7643f2e65cc8924&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:05.780889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:05.792394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9be46-aa53-4181-a2cf-29e53c818041 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:05.797465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:05.798739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:05.799239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:05.799723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:05.800797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:05.802620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e49ad-d621-4ebc-9234-46c63f9fa49a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:05.816673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 480/951] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:05 2021] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:09:06.693542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb9b5-a72e-423b-b7d1-36ac65ef032c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.693804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb9b5-a72e-423b-b7d1-36ac65ef032c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.696105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb9b5-a72e-423b-b7d1-36ac65ef032c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.696105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 472/952] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:06.704842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.704842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.704842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.732026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:06.734161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:06.748348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 481/953] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:06 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:06.771888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb9b5-a72e-423b-b7d1-36ac65ef032c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:06.785471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb9b5-a72e-423b-b7d1-36ac65ef032c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:06.790792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:06.791859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.792378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.792919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.793792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:06.795585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:06.807537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 16:09:06.809483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 473/954] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:06 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:06.817158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:06.834968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dff38-bdfb-4a6c-be42-ee48357c4ae3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:06.842936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:06.844871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.845763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.846486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.848058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:06.848890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:06.852129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:06.861738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 482/955] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:06 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:06.868391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:06.879317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722afca-735f-438c-b87c-b74420199d44 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:06.884326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:06.885320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.885802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.886264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.887181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:06.887676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:06.889587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0996c-5279-4aee-9207-55012a059892 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:06.896078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 474/956] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Dec 15 16:09:06 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:06.902594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:06.913487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f42de-cabe-4aec-add7-bc93fb871e21 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:06.918933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:06.920163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.920795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.921260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.922395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:06.924474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:06.948621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af213-e043-47f4-a6d9-5956cf366600 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.949239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af213-e043-47f4-a6d9-5956cf366600 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.949724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af213-e043-47f4-a6d9-5956cf366600 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.952146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 475/957] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:06.956565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 483/958] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:06 2021] POST /identity/v3/endpoints => generated 346 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:06.971320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:06.971952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:06.972409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:06.994920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:06.996592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:07.016148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 476/959] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:06 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:07.049477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:07.060929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00f7c-3083-48e4-a4c0-297666783e37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:07.066331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:07.067503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.067984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.068516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.069397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:07.071287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:07.084226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 16:09:07.086198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 484/960] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:07 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:07.092657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:07.103055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187314-f438-4b79-a0c7-eeba09395f29 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:07.108257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:07.108991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.109270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.109541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.110333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:07.110642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:07.112526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9882-163a-417b-859f-5ad50a55f4f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:07.119564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 477/961] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:07 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:07.126095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:07.137256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c116b-bd63-483d-889c-ad6e06eef7cd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:07.142190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:07.142859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.143185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.143457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.144179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:07.144556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:07.146255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0691b-cf5a-45b5-84f1-3dcff1722c30 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:07.152088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 485/962] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:07 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:08.323140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ef0a-3542-4ddc-b329-08a0eae82c83 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.323683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ef0a-3542-4ddc-b329-08a0eae82c83 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.324087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ef0a-3542-4ddc-b329-08a0eae82c83 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.328032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 478/963] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:08 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:08.339096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca276d23-2024-47d5-b7cb-b2d8dd502197 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.339620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca276d23-2024-47d5-b7cb-b2d8dd502197 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.340094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca276d23-2024-47d5-b7cb-b2d8dd502197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.371915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ca276d23-2024-47d5-b7cb-b2d8dd502197 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:08.373921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ca276d23-2024-47d5-b7cb-b2d8dd502197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:08.387225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 486/964] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:08 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:08.432085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ef0a-3542-4ddc-b329-08a0eae82c83 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.450469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4ae6-4ae4-4eac-8778-29c9144f1307 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.450787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4ae6-4ae4-4eac-8778-29c9144f1307 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.451069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4ae6-4ae4-4eac-8778-29c9144f1307 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.453197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ef0a-3542-4ddc-b329-08a0eae82c83 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.453326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 487/965] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:08.463831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.464724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.465155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.465384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.465730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.466028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.466295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.467141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.469024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.482533 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 16:09:08.484383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 479/966] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services/image => generated 86 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:08.495419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:08.497029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.499025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:08.512490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 488/967] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:08 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:08.515366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03510-2edd-401a-abea-c0e13f58b63b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.520843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.521818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.522245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.522677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.524033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:08.524705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.526481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.533379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 480/968] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services?name=image => generated 122 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:08.544180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.544752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.557373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29a634-afe3-4ae5-874f-a8deb7f260a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.561171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7866f-93eb-424d-8f22-e8403e070f76 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.563090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.565083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.565575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.566046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.566912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.568834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.570271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.571630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.572255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.572827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.574178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:08.574762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.577633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.585000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 16:09:08.592474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 489/970] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services?type=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:08.592814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 481/970] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:08.594874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.606787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b810-71c8-4f53-864f-00fb38e37331 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.613161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.614186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.614623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.615042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.615982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:08.616498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.618397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.625038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 490/971] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:08.632918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.645700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc7ab6-2a0e-4aca-af75-afe47819ab69 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.651101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.652088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.652579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.653004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.653975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:08.654510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.656390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407c280-39b7-435c-9f03-9c48c482ece4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.663700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 482/972] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:08 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:08.670571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:08.682505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33a29-3191-4f81-b834-3c4b98d0af92 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:08.687892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:08.689712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:08.690193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:08.690611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:08.691618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:08.693599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec9de-c9b8-4827-8cd8-a74d64c24a8b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:08.722198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 491/973] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:08 2021] POST /identity/v3/endpoints => generated 349 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:09:09.589282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb969-e6bc-4a9b-b8c2-70157e30c261 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:09.590889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb969-e6bc-4a9b-b8c2-70157e30c261 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:09.591818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb969-e6bc-4a9b-b8c2-70157e30c261 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:09.596556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 483/974] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:09 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:09.604049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:09.604893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:09.604893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:09.625756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:09.627448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:09.647974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 492/975] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:09 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:09.673644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb969-e6bc-4a9b-b8c2-70157e30c261 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:09.687283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb969-e6bc-4a9b-b8c2-70157e30c261 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:09.695888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:09.697631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:09.698450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:09.699253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:09.701010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:09.705459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:09.708674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.common [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 16:09:09.741955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.sql.core [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 16:09:09.741955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 16:09:09.741955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [parameters: {'id': '38d6c0dce3324a11b228927fd2821bd5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 16:09:09.741955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 16:09:09.774557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38d6c0dce3324a11b228927fd2821bd5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38d6c0dce3324a11b228927fd2821bd5. Dec 15 16:09:09.778189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 484/976] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Dec 15 16:09:09 2021] POST /identity/v3/projects => generated 262 bytes in 105 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:09.784786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:09.795051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f0824-c9ea-4b2d-9326-87102538a65c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:09.800712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:09.801902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:09.802381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:09.802845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:09.811361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:09.813891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:09.829050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e00a4f2e-ca8c-4be6-9a37-d8ef5b2e20b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:09.831196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 493/977] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:09.838019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:09.851163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bee75-1090-4723-a352-f2cf44d51c87 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:09.856288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:09.857193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:09.857635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:09.858044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:09.858964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:09.859420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:09.862151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37228-bdfe-4fe1-acbf-0b2ace9f5d80 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:09.885491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 485/978] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:09 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:11.104557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179431b3-c1d1-4b16-8d4e-3717a51b08b3 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:11.104557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179431b3-c1d1-4b16-8d4e-3717a51b08b3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:11.104557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179431b3-c1d1-4b16-8d4e-3717a51b08b3 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:11.104557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 494/979] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:11.119190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284e92-cfda-477c-8ac7-8310687b5897 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:11.120239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284e92-cfda-477c-8ac7-8310687b5897 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:11.120966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284e92-cfda-477c-8ac7-8310687b5897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:11.151916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a1284e92-cfda-477c-8ac7-8310687b5897 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:11.154639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a1284e92-cfda-477c-8ac7-8310687b5897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:11.168406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 486/980] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:11 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:11.192645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179431b3-c1d1-4b16-8d4e-3717a51b08b3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:11.207060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179431b3-c1d1-4b16-8d4e-3717a51b08b3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:11.212081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:11.213104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:11.213604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:11.214098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:11.215061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:11.216302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:11.216302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:09:11.216302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:09:11.217660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1322-6428-445f-a015-15c12e0f77cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:11.240586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 495/981] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:09:11 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:12.249252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0e8f5-8801-4a79-9718-90c932aa152a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.249815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0e8f5-8801-4a79-9718-90c932aa152a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.249815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0e8f5-8801-4a79-9718-90c932aa152a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.252526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 487/982] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:12.259503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.259503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.260137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.281732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:12.283310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:12.296740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e163ed-0992-49d2-b98b-7746126d0dbd None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.297050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e163ed-0992-49d2-b98b-7746126d0dbd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.297400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e163ed-0992-49d2-b98b-7746126d0dbd None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.304687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 488/983] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:12.307170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.307530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.309489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.310525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 496/984] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:12 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:12.331689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:12.332118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:12.339596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.342177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 489/985] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:12 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:12.350205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d2b0-7688-44d5-aa60-b30e522d4c8b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.357041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.359234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.359595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.359864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.361791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.364282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef11bc-873b-4522-bb31-d9af8690b477 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.372208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.382540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 497/986] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:09:12 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:12.383184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b546b6c-c96f-494d-9dff-39b8f1bef3f9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.404479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.405220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.405566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.405846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.406611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.409000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.424363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 16:09:12.425736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 490/987] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:12.426607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a8c-f9c8-4793-b294-e8c12f101b2e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.428145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a8c-f9c8-4793-b294-e8c12f101b2e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.428572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a8c-f9c8-4793-b294-e8c12f101b2e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.431945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 498/988] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:12 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:12.434103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.439178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.439460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.439890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.448029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb936-0b14-46bc-8db6-49ff8ec31945 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.459924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:12.461372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:12.465675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.467650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.467650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.467869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.469266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:12.471143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.473947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.476965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 499/989] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:12 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:12.481716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 491/990] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:12.489219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.498149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.499683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491822e-d867-4795-ac38-d373e7860ad4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.506724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.507432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.508019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.508295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.509098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:12.509406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.510038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3397b-7769-4c28-8bba-2f153d3ba9e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.511078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.516173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.518805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 500/991] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:12.524664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.524664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.524664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.524664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.524664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.529716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.539819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.sql.core [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 16:09:12.539819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 16:09:12.539819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [parameters: {'user_id': 'c5d9d4deaede43cd95e6fe730041bf97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 16:09:12.539819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 16:09:12.540258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd7c5-db4b-4150-b0c7-f1d2e3b7dbce admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.545547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.546308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.546590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.546906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.548627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] RBAC: Adding query filter params (interface=admin, service_id=d55dac05e5814366a7643f2e65cc8924, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:12.548627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.549869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 16:09:12.550445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.559034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 492/992] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:09:12 2021] POST /identity/v3/users => generated 160 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:12.563745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.566495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 501/993] 10.222.0.30 () {56 vars in 1270 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/endpoints?service_id=d55dac05e5814366a7643f2e65cc8924&interface=admin®ion_id=RegionOne => generated 193 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:12.574967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.578496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9633-3742-4141-a8c4-456b0679cba1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.584661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.585537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.586660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.586660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.595798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.596553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630e85f-444c-42f0-9309-e5302522092b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.598326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.606506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.607634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.608137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.608641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.609570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.612085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0e19c-954a-4152-ae5e-f744d0d633e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.615828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 16:09:12.620845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 502/995] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/services => generated 1957 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:09:12.628500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 493/995] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:12.628500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:12.647437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563679e6-24cb-4b5b-9523-0df56099f528 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:12.656243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:12.658538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:12.659088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:12.659718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:12.661503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:12.662052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:12.666537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93b780-cda1-4dd8-b658-cba601a2c4eb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:12.749953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 494/996] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Dec 15 16:09:12 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:14.115056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7105a1-22ce-4698-84c9-c91be0572f46 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.115876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7105a1-22ce-4698-84c9-c91be0572f46 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.115876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7105a1-22ce-4698-84c9-c91be0572f46 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.120507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 503/997] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:14.132643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.134039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.134039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.163519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:14.166137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:14.179347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 495/998] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:14 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:14.217102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7105a1-22ce-4698-84c9-c91be0572f46 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:14.231852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7105a1-22ce-4698-84c9-c91be0572f46 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:14.237739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:14.238544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.238818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.239085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.239748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:14.241373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:14.262022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 16:09:14.263893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 504/999] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:14 2021] GET /identity/v3/services/compute => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:14.273851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:14.284392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afadfa4-b62a-4c8c-b9e1-ae567ec3877d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:14.289321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:14.289994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.290273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.290543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.291454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:14.291761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:14.293407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:14.300018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 496/1000] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:14 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:14.306164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:14.317536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946c1c-566a-43d9-99ad-9c04b5a0849f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:14.322422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:14.323088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.323349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.323603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.324329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:14.324668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:14.326323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:14.332654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 505/1001] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:14 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:14.339444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:14.355753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9089b-8d3b-453a-a210-4b513f54092b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:14.363741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:14.364941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.365486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.365883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.367365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] RBAC: Adding query filter params (interface=public, service_id=5cf1d5f77e484157a9b5be890c153037, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:14.367904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:14.370935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2ef6d-29f7-472d-8d62-ed975138d565 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:14.380755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 497/1002] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:09:14 2021] GET /identity/v3/endpoints?service_id=5cf1d5f77e484157a9b5be890c153037&interface=public®ion_id=RegionOne => generated 194 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:14.387942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:14.404628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0db69-acdf-449a-b704-f08785a9addb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:14.413057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:14.414178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.414652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.415133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.416344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:14.419426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c675-ff14-4db7-bb30-e8339eb83014 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:14.435442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 506/1003] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:14 2021] GET /identity/v3/services => generated 1957 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:09:14.991917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5776-d6c3-443d-ae28-2946f8c2fe5d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:14.992353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5776-d6c3-443d-ae28-2946f8c2fe5d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:14.992883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5776-d6c3-443d-ae28-2946f8c2fe5d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:14.995877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 498/1004] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:15.002633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.002932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.003238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.026093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:15.027302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:15.035742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 507/1005] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:15 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:15.060092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5776-d6c3-443d-ae28-2946f8c2fe5d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.074728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5776-d6c3-443d-ae28-2946f8c2fe5d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.079956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.081008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.081432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.081845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.082696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.084560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.097337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f3f28751-49b7-4ef8-b137-6428ed064259 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 16:09:15.099100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 499/1006] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:15.106013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.116241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e094963-9ea6-4970-b37e-125d8432e06e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.125935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.126846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.127438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.127878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.128874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:15.129352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.131138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.134725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164af0-4b10-4bb5-af52-c5693ffe4fe6 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.135425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164af0-4b10-4bb5-af52-c5693ffe4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.135425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164af0-4b10-4bb5-af52-c5693ffe4fe6 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.137279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 500/1007] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:15.138344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 508/1008] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services?name=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:15.143530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.143915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.144400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.145967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.165946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:15.166147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1468b-09d0-458b-b7aa-e915d3fb61b2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.167207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:15.173139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.174225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.174706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.175185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.175989 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 501/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:15 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:15.176515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:15.177116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.180081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.194545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 509/1010] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services?type=image => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:15.195802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.204560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.206461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74c71-151a-42e5-b6ea-77418c414cab None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.211340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.212117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.212350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.212983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.213580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] RBAC: Adding query filter params (interface=public, service_id=43b1604e1cbd4edab26d79e37cadb31f, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:15.213889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.215552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.221742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 502/1011] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/endpoints?service_id=43b1604e1cbd4edab26d79e37cadb31f&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:15.223171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2bd17-508c-4454-9596-ec535177d58d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.228049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.231063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.232573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.233351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.233885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.236950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.238234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efce7e-5989-46e9-a3df-2cbbb3d81eb1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.239975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.243017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.243511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.243792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.244063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.244793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.246375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.253582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 503/1012] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:09:15.263576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 16:09:15.268511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 510/1013] 10.222.0.30 () {56 vars in 1147 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:15.273859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.293918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc745-ec03-4379-8921-c28a27976dcb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.302621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.303891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.304382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.304975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.306408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:15.306938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.309658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.319931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 504/1014] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:15.330345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.343711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16de8-2c00-462a-bea1-6fb9c53d5127 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.351799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.353040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.353632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.354057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.355384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:15.355913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.359042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdafd0f-9111-457f-a83f-28eae3ad65f6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.370331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 511/1015] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Dec 15 16:09:15 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:15.380060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:15.398174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3217-006b-4d8a-b4a9-3e62a87c7fae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:15.406306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:15.407665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:15.408330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:15.408593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:15.410000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:15.413203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0da0-1bbd-44c4-9132-bda59f14d73e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:15.443694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 505/1016] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:15 2021] POST /identity/v3/endpoints => generated 325 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:17.146032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f3f9-3d68-4e10-9392-3259419c5363 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.146628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f3f9-3d68-4e10-9392-3259419c5363 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.147025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f3f9-3d68-4e10-9392-3259419c5363 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.150508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 512/1017] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:17.157526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.157526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.157526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.178305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:17.179516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:17.200279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 506/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:17 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:17.225820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f3f9-3d68-4e10-9392-3259419c5363 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:17.246241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f3f9-3d68-4e10-9392-3259419c5363 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:17.253365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:17.254722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.255188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.255669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.257060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:17.259858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:17.280886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 16:09:17.288476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 513/1019] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:17 2021] GET /identity/v3/services/compute => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:17.294883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:17.307310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bcbe4-0c79-4e89-8376-44212d682aa0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:17.313775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:17.314655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.315002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.315349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.316223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:17.316639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:17.318565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:17.325234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 507/1020] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:17 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:17.332101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:17.344208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e313fe-96eb-4b95-93db-9641c5022cc3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:17.351452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:17.352950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.353684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.354466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.356127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:17.357048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:17.360358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f55e93-258a-4903-ab11-fda0b731fac5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:17.370935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 514/1021] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Dec 15 16:09:17 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:17.379886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:17.397095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6df90-df2a-4a0b-a287-3a2c5d490435 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:17.405262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:17.406457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:17.406954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:17.407526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:17.408982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:17.411977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2479-f0e1-464c-af4d-69f803fb9cbd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:17.441534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 508/1022] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:17 2021] POST /identity/v3/endpoints => generated 334 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:18.029283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497856-032b-4c6f-87c0-0ef69336b06f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.029859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497856-032b-4c6f-87c0-0ef69336b06f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.030317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497856-032b-4c6f-87c0-0ef69336b06f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.033815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 515/1023] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:18 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:18.040063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.040422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.040655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.059354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:18.060588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:18.079493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 509/1024] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:18 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:18.104499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497856-032b-4c6f-87c0-0ef69336b06f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:18.130160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497856-032b-4c6f-87c0-0ef69336b06f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:18.137179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:18.138508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.138956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.139398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.141514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:18.144725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09026-9bdb-45ca-83b2-b97cff60cca2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:18.152471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 516/1025] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:18.155282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:18.165970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306bd54-5585-4022-9519-6c08f6179341 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:18.171756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:18.172667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.173111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.173449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.174282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:18.176306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136fb04-81fc-4a0c-af70-f57fc3a504d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:18.211956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 510/1026] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:09:18 2021] POST /identity/v3/projects => generated 311 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:09:18.908858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43783f7a-6185-42de-8d3b-b0c9ce4185ff None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.909376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43783f7a-6185-42de-8d3b-b0c9ce4185ff None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.909875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43783f7a-6185-42de-8d3b-b0c9ce4185ff None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.913323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 517/1027] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:18 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:18.924214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:18.924738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:18.925237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:18.955403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:18.957399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:19.069214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 511/1028] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:18 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:19.112620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43783f7a-6185-42de-8d3b-b0c9ce4185ff None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:19.142777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43783f7a-6185-42de-8d3b-b0c9ce4185ff None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:19.151320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:19.152750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:19.153545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:19.153802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:19.154992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:19.158144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:19.178571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 16:09:19.180935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 518/1029] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Dec 15 16:09:19 2021] GET /identity/v3/services/image => generated 86 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:19.192026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:19.206564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5518-8a96-4b5b-a8be-47da4c4a7f64 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:19.214066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:19.215288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:19.215806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:19.216313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:19.217688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:19.218251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:19.221824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:19.231497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 512/1030] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:19 2021] GET /identity/v3/services?name=image => generated 122 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:19.242683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:19.258704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e18e5f-a863-48fd-ae72-94f44c986169 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:19.265814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:19.266978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:19.267437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:19.267882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:19.269137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:19.269602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:19.272319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dd5e6-68b6-4e7e-a316-48d19f74f71c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:19.282118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 519/1031] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:19 2021] GET /identity/v3/services?type=image => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:19.292468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:19.308515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9e10-854c-490a-af16-c599c143bea7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:19.316110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:19.317090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:19.317658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:19.318087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:19.319263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:19.322095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b708f4d-5d8d-4118-a110-7864bdf7cb29 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:19.354540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 513/1032] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:09:19 2021] POST /identity/v3/endpoints => generated 327 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:09:20.261596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128aef-b495-42f5-b9ad-731958105950 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.262148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128aef-b495-42f5-b9ad-731958105950 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.262586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128aef-b495-42f5-b9ad-731958105950 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.265952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 520/1033] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:20.272830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.273589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.273589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.292893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:20.294090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:20.319155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 514/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:20.345727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1128aef-b495-42f5-b9ad-731958105950 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.367365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1128aef-b495-42f5-b9ad-731958105950 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.375546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.376990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.377473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.377973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.398225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:20.412987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:09:20.416190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 521/1035] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:20.422165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.432654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3f43-8922-44ff-82c7-66f0c225e7f2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.439100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.440113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.440490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.440838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.441717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:20.442124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.443875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.454707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 515/1036] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:20.461301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.473051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6d0b-ce7d-49de-9810-efe06b43a97a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.478044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.478918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.479251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.479599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.491972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.493844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.513342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:20.514813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 522/1037] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:20.522483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.539991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03272a5-d4c9-402c-8c6b-3ceac519549a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.547944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.549288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.549787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.550284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.551690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:20.552238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.555441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.579888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 516/1038] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:20.585689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.597282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c3ba-d01c-4e9b-9821-41f267fdaa23 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.603029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.603938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.604284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.604655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.614432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.616634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.633070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:09:20.634500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 523/1039] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:20.642573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.660966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4294d7c-b3f2-4688-bb4d-91ab66c4a94a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.669676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.670878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.671366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.671796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.673519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:20.674019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.677913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.716285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 517/1040] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:20.718170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.729662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a013-b005-475f-87f6-7a874d5a9117 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.734699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.735569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.736633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.736960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.746653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.748601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed947b6-fc31-4de1-b76c-c50428b8d803 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.759754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 524/1041] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:09:20.766217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.777455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885328-1b4a-4e13-85c5-ce467b21dff2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.783532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.784356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.784691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.784933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.795708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d0e5-276d-4a5a-8321-d438541db2d8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.795981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d0e5-276d-4a5a-8321-d438541db2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.796260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d0e5-276d-4a5a-8321-d438541db2d8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.797439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.798356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 525/1042] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:20.800298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.804750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.805038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.805289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.818935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:20.824275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:20.825035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 518/1043] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:20.825507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:20.826541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.834343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 526/1044] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:20.838338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba960c-5cf1-4157-8b97-98227273bf5b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.843453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.844097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.844474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.845060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.846435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:20.846727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.848367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.859777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.862691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 519/1045] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:20.869489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89551ce9-49f5-4592-a139-27ba95124b0f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.870666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.874566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.875837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.876239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.877310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.878937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.881004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.881634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3a08-8230-4465-9079-92bbe6fc6b53 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.883533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 527/1046] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:20.890193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.894378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.895654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.896087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.896571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.905867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6b20-020b-4074-a3d5-1da45a9a38d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.909217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.912858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.913209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.914239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.914678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.915110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.916307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.919646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:20.936355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:20.946563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 520/1047] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:20.947896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 528/1048] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:09:20 2021] POST /identity/v3/users => generated 285 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:09:20.948103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:20.973080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6cc21-b630-4967-8b57-54ce038331e1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:20.979943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:20.981037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:20.981470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:20.981894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:20.983180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:20.983671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:20.987724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffecb4-7584-4f04-9bf5-85a62725a768 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:21.015860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 521/1049] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:09:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:21.023419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:21.035992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b15-ff1d-4851-9d1c-73388b9c7ac4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:21.041854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:21.042634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:21.042915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:21.043191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:21.044088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] RBAC: Adding query filter params (role.id=71e0cefe69df4df08ecbbcbe51454429, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:21.044403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:21.046349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202ba0-cfa8-4184-b4c5-14d9d4ebcde6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:21.060869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 529/1050] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:21 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=71e0cefe69df4df08ecbbcbe51454429 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:22.797268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28e05f-055e-4d7c-b991-81990481fa78 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:22.798125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28e05f-055e-4d7c-b991-81990481fa78 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:22.798125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28e05f-055e-4d7c-b991-81990481fa78 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:22.800474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 522/1051] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:22.810369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:22.810907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:22.811280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:22.841133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:22.843084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:22.856385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 530/1052] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:22.894966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28e05f-055e-4d7c-b991-81990481fa78 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:22.915723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28e05f-055e-4d7c-b991-81990481fa78 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:22.923031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:22.924089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:22.924562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:22.925030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:22.939171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:22.942361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91b3e-33ff-4fe2-9e4e-d912d6ff0d9e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:22.958835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 523/1053] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:22.968902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:22.984638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4564f-5e69-4de9-906f-789f59dcc9d7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:22.992311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:22.993659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:22.994128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:22.994547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:22.996539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:22.999589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2689b-6430-4338-9338-71a8de0ecc80 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:23.002604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 531/1054] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:23.902043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bcaca-15db-4488-8f13-fcacfa2cca06 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:23.902682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bcaca-15db-4488-8f13-fcacfa2cca06 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:23.902682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bcaca-15db-4488-8f13-fcacfa2cca06 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:23.904386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 524/1055] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:23.910875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343f8b-83a8-4ed6-999a-b94c08c0bfe1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:23.911455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343f8b-83a8-4ed6-999a-b94c08c0bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:23.911455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343f8b-83a8-4ed6-999a-b94c08c0bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:23.936167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ad343f8b-83a8-4ed6-999a-b94c08c0bfe1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:23.938180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ad343f8b-83a8-4ed6-999a-b94c08c0bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:23.949522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3973-5c4d-41ec-a693-7e6b53374b55 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:23.949797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3973-5c4d-41ec-a693-7e6b53374b55 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:23.950069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3973-5c4d-41ec-a693-7e6b53374b55 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:23.951728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 532/1056] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:23.952080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 525/1057] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:23.958747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:23.959136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:23.959517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:23.976992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3973-5c4d-41ec-a693-7e6b53374b55 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:23.979132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:23.980318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:23.988313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 533/1058] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:23.991136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3973-5c4d-41ec-a693-7e6b53374b55 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:23.995643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:23.996457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:23.996753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:23.997031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.011800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.012151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:24.020337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:24.021821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 526/1059] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:24.022159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b0940-037e-43c6-9b2d-30db55b60fa8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.026911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.027739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.027991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.028259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.028729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.039439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:24.040268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c804-cd86-4c84-a18d-aeece9dde862 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.045645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.046311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.046589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.046722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:09:24.046852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.047618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.047909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 534/1060] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:24.048103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.049706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.056002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.060168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 527/1061] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:24.066568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0640-3fab-4b9f-bb95-f69772392843 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.067242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.072021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.072980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.073283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.073544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.074321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.074624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.076274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.077860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfe80-4790-4f12-8211-2dad839fc188 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.083808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.084733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.085013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.085347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] PATH_INFO: `/v3/users/d7ed1b18d3d049568c40d3e754acf291` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.086656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 535/1062] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:24.094140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.103024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7ed1b18d3d049568c40d3e754acf291)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.104462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799774c-942d-4874-9795-b91278fb224f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.105253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.106998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 528/1063] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/users/d7ed1b18d3d049568c40d3e754acf291 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:24.109282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.110078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.110352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.111035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.113696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.122964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.124171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58370-dfb1-404f-b243-68efc7955524 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.125327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.130166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.130818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.131090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.131358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.140041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.141847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.143307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:24.144790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 536/1064] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:24.151583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.156579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 529/1065] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:24.159668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.162712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f964a-8e95-4f3f-9a56-09f84ef32be8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.167776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.168490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.168776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.169084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.169248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e27-ef9f-4a65-aafa-ade85504b6d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.169811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.170146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.171783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.174535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.175454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.175736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.176000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.177385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.179449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.181336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 530/1066] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:24.185597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 537/1067] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:24.188853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.192346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.199470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f43f-dd69-4a2b-b6ba-d2625001efe1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.203031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57815-5fce-44e1-b52a-39840d22a127 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.204735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.205407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.205676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.205959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.206821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=d5bb1390abe34660a200bace95f19875, user.id=d7ed1b18d3d049568c40d3e754acf291) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.207134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.208347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.209013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.209180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.209463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.209745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.215516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 531/1068] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/role_assignments?user.id=d7ed1b18d3d049568c40d3e754acf291&scope.project.id=d5bb1390abe34660a200bace95f19875&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:24.222400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.222400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.238654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:09:24.240112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 538/1069] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:24.247068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.258654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961fc60-e553-4bc8-a0e2-e62627dddc27 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.263914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.264655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.264940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.265214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.266113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.266423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.268392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.291741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 532/1070] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:24.299495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.310926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a622b-a500-420a-ab1b-ecf5e3010730 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.316879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.317900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.318185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.318462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.332278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.334258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.353369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:24.354664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 539/1071] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:24.361645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.372455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c130d-33ed-41ad-9b88-2b7a23d73ece admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.377593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.378294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.378574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.378850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.379625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.379953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.381662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.395590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 533/1072] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:24.402574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.413593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b067-1ef1-4d7d-af85-5a5d369ba482 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.419009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.419831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.420105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.420463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.429249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.431287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.446864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:24.448153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 540/1073] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:24.455463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.466164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffed6eb-7aed-4b3c-8067-7ebbfcc009b2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.472118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.472835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.473106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.473373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.474186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:24.474490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.477420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e541a-0b90-469b-b523-00bf33c8046d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.495340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 534/1074] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:09:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:24.502649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:24.512837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25119d3b-ee41-4fe3-ae51-c36b1991dd72 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:24.517982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:24.518903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:24.519185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:24.519469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/71e0cefe69df4df08ecbbcbe51454429` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:24.522095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=713e877ea43e442788f807e02578d0d6, role_id=71e0cefe69df4df08ecbbcbe51454429)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:24.524964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b1f88-bb7e-40f0-bd33-4b84dfd87d21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:24.541808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 541/1075] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:09:24 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/713e877ea43e442788f807e02578d0d6/roles/71e0cefe69df4df08ecbbcbe51454429 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:09:26.672686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246555-c226-4960-8407-8d9c5fcaf037 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.673583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246555-c226-4960-8407-8d9c5fcaf037 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.673583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246555-c226-4960-8407-8d9c5fcaf037 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.675920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 535/1076] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:26.682705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.683265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.683265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.702787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:26.704131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:26.779111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 542/1077] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:26.803342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246555-c226-4960-8407-8d9c5fcaf037 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:26.816807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246555-c226-4960-8407-8d9c5fcaf037 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:26.821341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:26.822138 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.822418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.822697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.834010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:26.840906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:26.842315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 536/1078] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:26.849312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:26.859004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543d05d-be5e-4b40-8691-bacce53e6d77 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:26.863848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:26.864542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.864819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.865112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.865877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:26.866184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:26.867792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:26.877208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 543/1079] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:26.883585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:26.894217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7edd-c4b3-41d3-9f3d-b3538ff2e12f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:26.898978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:26.899863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.900143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.900406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] PATH_INFO: `/v3/users/d7ed1b18d3d049568c40d3e754acf291` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.901766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7ed1b18d3d049568c40d3e754acf291)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:26.904019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:26.905976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 537/1080] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:26 2021] GET /identity/v3/users/d7ed1b18d3d049568c40d3e754acf291 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:26.912549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:26.923673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3212e5-cb9a-4710-a5dd-cd62c40d6042 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:26.928855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:26.929747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.930169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.930287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.931616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:26.933860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234d0b-3bf5-4d9a-8ff6-ccbdfd0530fc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:26.935706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 544/1081] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:26 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:26.943167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:26.956204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b32214-a18d-47a2-87d4-dc1342506955 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.956656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b32214-a18d-47a2-87d4-dc1342506955 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.956937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b32214-a18d-47a2-87d4-dc1342506955 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.957524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfca0a-801c-46ad-abe0-9f336a7515c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:26.958736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 545/1082] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:26.963338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:26.964170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.964632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.964807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875/users/d7ed1b18d3d049568c40d3e754acf291/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.965733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:26.966032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:26.966310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:26.967002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bb1390abe34660a200bace95f19875, user_id=d7ed1b18d3d049568c40d3e754acf291, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:26.969729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:26.986236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 538/1083] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:09:26 2021] PUT /identity/v3/projects/d5bb1390abe34660a200bace95f19875/users/d7ed1b18d3d049568c40d3e754acf291/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:09:26.990549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:26.992034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:27.072308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 546/1084] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:27.098177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.108993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe2b-4df9-42b2-ba5e-65cf0944a1eb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.114351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.115198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.115480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.115754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.130759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:27.138705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 16:09:27.140023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 539/1085] 10.222.0.30 () {56 vars in 1141 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:27.147467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.157766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec91a56-7a37-48bd-88ff-8d5bf53c249c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.163695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.164402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.164726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.165000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.165783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.166089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.167757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.177592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 547/1086] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:27.184257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.196019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb781-39a7-468a-a684-a84172ba7214 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.202174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.202998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.203277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.203544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.217474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.219948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.238956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:27.240192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 540/1087] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:27.246989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.258227 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb338e-f5c1-47c4-9441-e9234cf24cc2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.263316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.264008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.264286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.264600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.265373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.265680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.268177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.288477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 548/1088] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:27.293585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.310247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106d34b-cb91-4967-ac12-426aa03f5eee admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.317342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.318746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.319265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.319752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.336238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.340179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.367525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 16:09:27.369814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 541/1089] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:27.380284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.391893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef51d7-6d5b-43a7-9f30-871a59b1d4b2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.398632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.399312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.399588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.399856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.401305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.401305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.402895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.423447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 549/1090] 10.222.0.30 () {56 vars in 1154 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:27.430631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.442643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748893b9-c775-4274-977c-f7078a6505af admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.447877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.448607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.448891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.449166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.458774 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.460613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.471173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 542/1091] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:27.480145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.494790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495e4f9-4d65-4328-a122-729fe0ea2f0d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.500208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.502219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.502622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.503158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.515661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.517695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.536638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:09:27.538146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 550/1092] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:27.544720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.554948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee151021-33c7-42b0-b16c-8fff9a11640b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.559902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.560647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.560930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.561204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.561981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.562284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.564160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.581059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 543/1093] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:27.587688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.598567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd1c2-d08f-47a8-ac0c-0ed573e475fc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.603492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.604321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.604636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.604909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.613638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.615741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.630337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:09:27.632077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 551/1094] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:09:27.639039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.650021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2b18-0342-45d1-843e-7d38d4e92c52 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.654949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.655647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.655928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.656202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.657078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.657419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.659340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fdfed-03c7-4063-bd5e-e2bc07dc9361 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.678824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 544/1095] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:27.683826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:27.695011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43913ecb-b24c-48be-be19-85a074bf0183 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:27.700799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:27.701548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:27.701995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:27.702546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:27.703168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] RBAC: Adding query filter params (role.id=71e0cefe69df4df08ecbbcbe51454429, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=713e877ea43e442788f807e02578d0d6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:27.703537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:27.705930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c52eb-fbab-40a9-a9c2-500c3137515d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:27.712825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 552/1096] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:27 2021] GET /identity/v3/role_assignments?user.id=713e877ea43e442788f807e02578d0d6&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=71e0cefe69df4df08ecbbcbe51454429 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:29.461942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883612-958c-402b-b556-e0cb43e3a667 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.462495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883612-958c-402b-b556-e0cb43e3a667 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.462495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883612-958c-402b-b556-e0cb43e3a667 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.464143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 545/1097] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:29.471490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.471998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.471998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.490390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:29.491589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:29.500506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 553/1098] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:29.525068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883612-958c-402b-b556-e0cb43e3a667 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.538520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883612-958c-402b-b556-e0cb43e3a667 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.543953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.544775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.545048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.545312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.556657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:29.563409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:29.564893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 546/1099] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:29.571679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.581231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2230-ece2-4164-bda6-66b9e678a5a7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.586040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.586692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.586969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.587234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.587976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:29.588275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:29.589943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:29.599474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 554/1100] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:29.606154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.617889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee7622-910b-4668-9fa3-2df2269aef4b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.623936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.624879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.625130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.625408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] PATH_INFO: `/v3/users/d7ed1b18d3d049568c40d3e754acf291` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.627230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] RBAC: Authorizing `identity:get_user(user_id=d7ed1b18d3d049568c40d3e754acf291)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:29.629592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:29.631359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 547/1101] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/users/d7ed1b18d3d049568c40d3e754acf291 => generated 285 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:29.638688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.649489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07241c-e104-4792-94b5-34a95437452d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.655205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.655849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.656125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.656393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.665578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:29.667325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:29.676964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 555/1102] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:29.683842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.694433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1965dd-f7f9-4e85-bafb-4ab61092006e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.699339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.700221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.700567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.700869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.702223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:29.704550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a65560-5ac3-4cee-a69f-cb70273924fa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:29.706418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 548/1103] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:29.713511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:29.723262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b1f30-883e-4c9c-aa2c-56212ccf5c1b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:29.728309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:29.728989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:29.729263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:29.729537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:29.730413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=d5bb1390abe34660a200bace95f19875, user.id=d7ed1b18d3d049568c40d3e754acf291) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:29.730725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:29.732660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6622e-57a3-4fbb-a247-6bbe08a00c41 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:29.739240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 556/1104] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:29 2021] GET /identity/v3/role_assignments?user.id=d7ed1b18d3d049568c40d3e754acf291&scope.project.id=d5bb1390abe34660a200bace95f19875&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:32.168058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da77b-9e71-4a26-a72c-84fcf9a5062a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:32.168641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da77b-9e71-4a26-a72c-84fcf9a5062a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:32.168641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da77b-9e71-4a26-a72c-84fcf9a5062a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:32.170415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 549/1105] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:32.176900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:32.177322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:32.177455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:32.196070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:32.197287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:32.205681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 557/1106] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:32.232605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da77b-9e71-4a26-a72c-84fcf9a5062a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:32.247548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da77b-9e71-4a26-a72c-84fcf9a5062a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:32.253019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:32.253810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:32.254089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:32.254361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:32.255586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:32.257325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60013-4473-4bb0-b62e-3d0675746ab8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:32.258955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 550/1107] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:32.265512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:32.275344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec8c8-0fd5-4f7d-81e2-8f69ea996475 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:32.281171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:32.281836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:32.282108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:32.282371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:32.283397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:32.285351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ccd5b-34b0-402e-b724-32e4397e6ee5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:32.310428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 558/1108] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:09:32 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:34.730001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1779-5fb0-4cae-ab28-e58b6a7d9d4e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.730603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1779-5fb0-4cae-ab28-e58b6a7d9d4e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.730603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1779-5fb0-4cae-ab28-e58b6a7d9d4e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.732270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 551/1109] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:34.740563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.741392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.741392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.759950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:34.761164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:34.769718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 559/1110] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:34.794343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa1779-5fb0-4cae-ab28-e58b6a7d9d4e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:34.806685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa1779-5fb0-4cae-ab28-e58b6a7d9d4e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:34.810943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:34.811768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.812046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.812321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] PATH_INFO: `/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.813951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] RBAC: Authorizing `identity:get_role(role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:34.814912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:34.814912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:09:34.814912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:09:34.815778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:34.817153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 552/1111] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:34 2021] GET /identity/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:34.823429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:34.833054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913fec6-3a3f-461b-80a2-90b5100b91d3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:34.838699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:34.839562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.839841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.840107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] PATH_INFO: `/v3/users/835498016a844a9285550f033e94a21e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.855419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] RBAC: Authorizing `identity:get_user(user_id=835498016a844a9285550f033e94a21e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:34.857661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:34.859358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 560/1112] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:34 2021] GET /identity/v3/users/835498016a844a9285550f033e94a21e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:34.865904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:34.875615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e287f4-c16a-4fbf-8b09-5aa826ba550b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:34.880658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:34.881294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.881573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.881841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.889522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:34.891256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:34.900479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 553/1113] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:34.907155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:34.917892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9d08-3591-446e-bfc4-165e7a7f5c3e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:34.924189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:34.925126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.925404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.925680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.927002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:34.929150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49958e2-ccc3-456f-817a-b729c2b8888e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:34.930916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 561/1114] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:34 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:34.938272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:34.948679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d789f0-4e08-4a54-a08c-6bbc3bf30799 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:34.954804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:34.955642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:34.955922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:34.956193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:34.957213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=d5bb1390abe34660a200bace95f19875, user.id=835498016a844a9285550f033e94a21e) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:34.957523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:34.959354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9df3-d519-431d-9af9-931051839feb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:34.965405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 554/1115] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:34 2021] GET /identity/v3/role_assignments?user.id=835498016a844a9285550f033e94a21e&scope.project.id=d5bb1390abe34660a200bace95f19875&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:37.364882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81379-9b33-43c9-bdd1-cd5d3bdf2885 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.365435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81379-9b33-43c9-bdd1-cd5d3bdf2885 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.365435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81379-9b33-43c9-bdd1-cd5d3bdf2885 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.367188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 562/1116] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:37.373345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.373771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.373771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.392822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:37.394009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:37.402241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 555/1117] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:37.426629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81379-9b33-43c9-bdd1-cd5d3bdf2885 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:37.440049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81379-9b33-43c9-bdd1-cd5d3bdf2885 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:37.445272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:37.446107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.446377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.446644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] PATH_INFO: `/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.448245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] RBAC: Authorizing `identity:get_role(role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:37.449312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:37.449312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:09:37.449312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:09:37.450183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:37.451504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 563/1118] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:37 2021] GET /identity/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:37.458342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:37.467465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b9d4d-a9d0-4497-b117-29932ac9357e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:37.473361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:37.474225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.474502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.474775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] PATH_INFO: `/v3/users/835498016a844a9285550f033e94a21e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.476024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] RBAC: Authorizing `identity:get_user(user_id=835498016a844a9285550f033e94a21e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:37.478152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:37.479725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 556/1119] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:37 2021] GET /identity/v3/users/835498016a844a9285550f033e94a21e => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:37.486173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:37.496340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76177e4-910c-417b-826e-cc025f569fb0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:37.502112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:37.502959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.503231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.503860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.505192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:37.507221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96105-88f0-4e50-a845-d41ecc3e64b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:37.508908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 564/1120] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:37 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:37.515347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:37.526019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75702cbd-4cf8-4d25-8287-a120bfaa514d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:37.531031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:37.531912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:37.532184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:37.532466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875/users/835498016a844a9285550f033e94a21e/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:37.535916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bb1390abe34660a200bace95f19875, user_id=835498016a844a9285550f033e94a21e, role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:37.538598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb8a3d-4d0e-41fa-bf5e-fddd1e872ca3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:37.553832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 557/1121] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:09:37 2021] PUT /identity/v3/projects/d5bb1390abe34660a200bace95f19875/users/835498016a844a9285550f033e94a21e/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:09:39.920888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802fb4-7525-42f4-a8a8-a67e044f018e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:39.921439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802fb4-7525-42f4-a8a8-a67e044f018e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:39.921439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802fb4-7525-42f4-a8a8-a67e044f018e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:39.923211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 565/1122] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:39.929432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:39.929880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:39.929973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:39.949120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:39.950319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:40.012201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 558/1123] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:40.036919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a802fb4-7525-42f4-a8a8-a67e044f018e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:40.051045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a802fb4-7525-42f4-a8a8-a67e044f018e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:40.056035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:40.056908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:40.057183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:40.057435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] PATH_INFO: `/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:40.058940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] RBAC: Authorizing `identity:get_role(role_id=03b5e4dc77e34cf49b9b539121ae8a89)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:40.060574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:40.061872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 566/1124] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:40 2021] GET /identity/v3/roles/03b5e4dc77e34cf49b9b539121ae8a89 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:40.068581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:40.077739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021828b-ef59-4cb6-8818-2a6df2c47f77 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:40.083022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:40.083901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:40.084176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:40.084467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] PATH_INFO: `/v3/users/835498016a844a9285550f033e94a21e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:40.085792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] RBAC: Authorizing `identity:get_user(user_id=835498016a844a9285550f033e94a21e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:40.087949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:40.089705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 559/1125] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:40 2021] GET /identity/v3/users/835498016a844a9285550f033e94a21e => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:40.096901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:40.107347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35943ed2-73fc-4b63-9f24-b8e86254f94a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:40.112721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:40.113387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:40.113665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:40.113925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:40.122894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:40.124713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:40.134229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 567/1126] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:40.140997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:40.151503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9819-ad56-453b-9606-45224476a261 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:40.157365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:40.158846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:40.159125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:40.159399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] PATH_INFO: `/v3/projects/d5bb1390abe34660a200bace95f19875` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:40.160757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] RBAC: Authorizing `identity:get_project(project_id=d5bb1390abe34660a200bace95f19875)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:40.162806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ba1e1-ed09-4115-8a43-99a3f5d8aefd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:40.164525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 560/1127] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:40 2021] GET /identity/v3/projects/d5bb1390abe34660a200bace95f19875 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:40.171407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:40.180979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087fed-774f-4669-8ab9-42b5b4030d46 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:40.186036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:40.186679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:40.186958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:40.187235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:40.188076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] RBAC: Adding query filter params (role.id=03b5e4dc77e34cf49b9b539121ae8a89, scope.project.id=d5bb1390abe34660a200bace95f19875, user.id=835498016a844a9285550f033e94a21e) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:40.188386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:40.190399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95f26-6a2f-41e2-bfa3-5c2aeb419c7d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:40.196571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 568/1128] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:40 2021] GET /identity/v3/role_assignments?user.id=835498016a844a9285550f033e94a21e&scope.project.id=d5bb1390abe34660a200bace95f19875&role.id=03b5e4dc77e34cf49b9b539121ae8a89 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:42.626987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6491ad-53bb-4741-becf-374cf50f765b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:42.627588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6491ad-53bb-4741-becf-374cf50f765b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:42.627588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6491ad-53bb-4741-becf-374cf50f765b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:42.629483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 561/1129] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:42.635496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:42.635954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:42.636046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:42.656483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:42.657810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:42.667294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 569/1130] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:42.695123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6491ad-53bb-4741-becf-374cf50f765b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:42.708712 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6491ad-53bb-4741-becf-374cf50f765b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:42.713775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:42.714559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:42.714837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:42.715118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:42.716419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:42.718125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335aa21-0bb1-4157-af5a-6046a04e16cc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:42.719706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 562/1131] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:42.726647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:42.736142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc05a1-0805-441f-b4c1-a8c6fc53c8c8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:42.741586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:42.742239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:42.742512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:42.742777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:42.743494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:42.745430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6dbd-c963-41cb-bf61-93c93440ffa8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:42.774067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 570/1132] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:09:42 2021] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:45.139294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128324c-e9c0-4a16-b092-86a51411810a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:45.139816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128324c-e9c0-4a16-b092-86a51411810a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:45.139816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128324c-e9c0-4a16-b092-86a51411810a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:45.141639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 563/1133] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:45.147685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:45.148159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:45.148253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:45.167906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:45.169139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:45.233799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 571/1134] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:45.259393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128324c-e9c0-4a16-b092-86a51411810a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:45.273913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128324c-e9c0-4a16-b092-86a51411810a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:45.279338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:45.280127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:45.280407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:45.280709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:45.282053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:45.283772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaf091-f1cd-49c9-9cd6-2295306554dd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:45.285407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 564/1135] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:09:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:45.291774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:45.301715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294ee98-d7b6-4654-bbfa-e66cab473620 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:45.307067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:45.307734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:45.308010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:45.308280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:45.309038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:45.310943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b192ce0-3db1-4c8d-b6e1-29303d57f562 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:45.331714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 572/1136] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:09:45 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:09:47.816180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78275-b6a9-46b2-9f5f-231b099cfa98 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:47.816752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78275-b6a9-46b2-9f5f-231b099cfa98 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:47.816752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78275-b6a9-46b2-9f5f-231b099cfa98 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:47.818518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 565/1137] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:09:47.824753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:47.825255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:47.825348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:47.844913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:47.847396 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:47.856210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 573/1138] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:47.881360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea78275-b6a9-46b2-9f5f-231b099cfa98 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:47.895669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea78275-b6a9-46b2-9f5f-231b099cfa98 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:47.900412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:47.901252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:47.901530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:47.901801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:47.912313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:47.919002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:47.920185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 566/1139] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:47.927240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:47.936964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4eca-c36d-4106-b691-c0d834971cec None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:47.943559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:47.944247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:47.944564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:47.944834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:47.945602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:47.945899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:47.947522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:47.957578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 574/1140] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:47.964239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:47.975250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae63c1-3be6-48f3-9810-a4678522132e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:47.980165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:47.981039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:47.981316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:47.981586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] PATH_INFO: `/v3/users/1a75fef5737040ca99592f8bc56baa7b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:47.997152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a75fef5737040ca99592f8bc56baa7b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:47.999284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:48.000979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 567/1141] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:47 2021] GET /identity/v3/users/1a75fef5737040ca99592f8bc56baa7b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:48.007841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:48.018624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac52b6-b4fa-4af2-8aa0-5cb1aca4d2c5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:48.024630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:48.025286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:48.025564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:48.025836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:48.034910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:48.036735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:48.046051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 575/1142] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:48.053202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:48.063647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43720-cdeb-4cd3-8a64-95f81449d033 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:48.070062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:48.070848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:48.071120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:48.071395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] PATH_INFO: `/v3/projects/74cfaffb2f554baba4997552e01faf5b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:48.072747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] RBAC: Authorizing `identity:get_project(project_id=74cfaffb2f554baba4997552e01faf5b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:48.074789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550c5f2-3e6c-4403-980c-05c4bbfc5c3c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:48.076462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 568/1143] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:48 2021] GET /identity/v3/projects/74cfaffb2f554baba4997552e01faf5b => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:48.083138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:48.092576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71e10-e3dd-47f2-95be-0ffbff44b3c1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:48.098847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:48.099492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:48.099768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:48.100038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:48.100919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=74cfaffb2f554baba4997552e01faf5b, user.id=1a75fef5737040ca99592f8bc56baa7b) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:48.101232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:48.103085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939684b-3fd1-4ee0-aab9-76fa1a589bf7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:48.109080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 576/1144] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:48 2021] GET /identity/v3/role_assignments?user.id=1a75fef5737040ca99592f8bc56baa7b&scope.project.id=74cfaffb2f554baba4997552e01faf5b&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:50.510527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb934-da10-459d-a0bb-367adddabdb2 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.511070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb934-da10-459d-a0bb-367adddabdb2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.511070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb934-da10-459d-a0bb-367adddabdb2 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.512800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 569/1145] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:50.518985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.519446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.519537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.539041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:50.540239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:50.549789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 577/1146] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:50.574031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeb934-da10-459d-a0bb-367adddabdb2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:50.588566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeb934-da10-459d-a0bb-367adddabdb2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:50.593750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:50.594577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.594861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.595134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.606811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:50.614001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:50.615224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 570/1147] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:50.622182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:50.632045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668792e-9cd4-4088-94de-c6601f3f58a4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:50.637942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:50.638601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.638872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.639135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.639884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:50.640222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:50.641902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:50.650907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 578/1148] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:50.657578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:50.669640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189062bf-9133-4205-83df-f900fdadc5c2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:50.675147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:50.676006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.676277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.676578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] PATH_INFO: `/v3/users/1a75fef5737040ca99592f8bc56baa7b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.677841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a75fef5737040ca99592f8bc56baa7b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:50.679949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:50.681582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 571/1149] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:50 2021] GET /identity/v3/users/1a75fef5737040ca99592f8bc56baa7b => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:50.688125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:50.698375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a15a-97c0-4f37-9cb2-4295e69499a7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:50.704085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:50.705086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.705358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.705840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] PATH_INFO: `/v3/projects/74cfaffb2f554baba4997552e01faf5b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.707161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] RBAC: Authorizing `identity:get_project(project_id=74cfaffb2f554baba4997552e01faf5b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:50.709217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d258-9fb5-4f65-b654-cdc7ae61c648 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:50.710916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 579/1150] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:50 2021] GET /identity/v3/projects/74cfaffb2f554baba4997552e01faf5b => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:50.717552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:50.728234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d528-c881-48ac-9c8e-e686aff66032 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:50.733289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:50.734165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:50.734440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:50.734719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] PATH_INFO: `/v3/projects/74cfaffb2f554baba4997552e01faf5b/users/1a75fef5737040ca99592f8bc56baa7b/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:50.737364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cfaffb2f554baba4997552e01faf5b, user_id=1a75fef5737040ca99592f8bc56baa7b, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:50.740417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978bf78-89d9-450b-8b4b-527e18af80af admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:50.755675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 572/1151] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:09:50 2021] PUT /identity/v3/projects/74cfaffb2f554baba4997552e01faf5b/users/1a75fef5737040ca99592f8bc56baa7b/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:09:53.154065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccc088-5b5b-4779-9b2a-99207d1c9c6a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.154606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccc088-5b5b-4779-9b2a-99207d1c9c6a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.154606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccc088-5b5b-4779-9b2a-99207d1c9c6a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.156341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 580/1152] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:53.162514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.162993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.163101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.182223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:53.183421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:53.246158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 573/1153] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:53.270888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccc088-5b5b-4779-9b2a-99207d1c9c6a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.284129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccc088-5b5b-4779-9b2a-99207d1c9c6a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.288976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.289750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.290026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.290297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.301969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:09:53.308806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:09:53.309987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 581/1154] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:53.317113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.327908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5d17-0729-4ddb-a3d4-e15653b4e5c8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.333107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.333778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.334060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.334334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.335113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:53.335418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:53.337034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:53.345619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 574/1155] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:53.352831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.364182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdebe-b296-45d6-9633-54707cba3e99 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.369453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.370341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.370637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.370942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] PATH_INFO: `/v3/users/1a75fef5737040ca99592f8bc56baa7b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.372226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a75fef5737040ca99592f8bc56baa7b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:53.374331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:53.375917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 582/1156] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/users/1a75fef5737040ca99592f8bc56baa7b => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:09:53.383083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.398402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab48c92-8fb6-4d1d-adf2-720152c45535 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.404357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.405044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.405322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.405597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.414912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:53.416686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:53.426568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 575/1157] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:53.433343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.444129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c232ff3-52a3-476a-9eff-aea3a23b6322 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.449196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.450138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.450419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.450753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] PATH_INFO: `/v3/projects/74cfaffb2f554baba4997552e01faf5b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.452061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] RBAC: Authorizing `identity:get_project(project_id=74cfaffb2f554baba4997552e01faf5b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:53.454139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c9996-bc99-4a86-92d2-266a802955ef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:53.456731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 583/1158] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/projects/74cfaffb2f554baba4997552e01faf5b => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:53.464005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:53.474807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff014-9de0-4dfd-b7cb-def122c4ec8c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:53.480091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:53.480775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:53.481056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:53.481332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:53.482338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=74cfaffb2f554baba4997552e01faf5b, user.id=1a75fef5737040ca99592f8bc56baa7b) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:53.482669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:53.484654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debc005-f1de-447f-93f1-2abde7d11dd8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:53.491205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 576/1159] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:09:53 2021] GET /identity/v3/role_assignments?user.id=1a75fef5737040ca99592f8bc56baa7b&scope.project.id=74cfaffb2f554baba4997552e01faf5b&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:55.856673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5d2a-18b1-47e1-864f-30e278bc2312 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:55.857243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5d2a-18b1-47e1-864f-30e278bc2312 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:55.857243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5d2a-18b1-47e1-864f-30e278bc2312 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:55.858969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 584/1160] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:55.865800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:55.866258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:55.866346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:55.885760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:55.886982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:55.896212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 577/1161] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:55.925567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5d2a-18b1-47e1-864f-30e278bc2312 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:55.939917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5d2a-18b1-47e1-864f-30e278bc2312 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:55.945258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:55.945897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:55.946181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:55.946454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:55.954722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:55.956774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:55.966765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 585/1162] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:09:55 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:55.974324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:55.985326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb77ab6-8f56-4e43-8e4c-201559cb6a32 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:55.992463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:55.993323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:55.993598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:55.993910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:56.002019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:56.003857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:56.019167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-24a140f6-a64c-48c5-9602-cd93b061d42d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 16:09:56.020379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 578/1163] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:09:55 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:09:56.027552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:56.037256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e5bd-fff7-4ad1-a444-e91204001ea4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:56.043268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:56.043926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:56.044209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:56.044465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:56.045246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:09:56.045551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:56.047174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a8cdf-c191-4fd9-b4b2-b1626905ce3b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:56.055760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 586/1164] 10.222.0.30 () {56 vars in 1136 bytes} [Wed Dec 15 16:09:56 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:09:58.390602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34aff-543a-44fa-9925-7bf60c83435e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:58.391218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34aff-543a-44fa-9925-7bf60c83435e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:58.391218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34aff-543a-44fa-9925-7bf60c83435e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:58.392918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 579/1165] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:09:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:58.399002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fdde-c7a6-4a84-88a9-a77f571b0e86 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:58.399418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fdde-c7a6-4a84-88a9-a77f571b0e86 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:58.399556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fdde-c7a6-4a84-88a9-a77f571b0e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:58.418820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ef72fdde-c7a6-4a84-88a9-a77f571b0e86 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:58.420025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ef72fdde-c7a6-4a84-88a9-a77f571b0e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:58.428891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 587/1166] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:09:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:58.453283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a34aff-543a-44fa-9925-7bf60c83435e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:58.467103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a34aff-543a-44fa-9925-7bf60c83435e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:58.472910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:58.473559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:58.473833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:58.474107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:58.474858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:58.475869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:58.475869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:09:58.475869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:09:58.476771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421dee6-de1d-48c9-8cd1-a86cccb3f440 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:58.492287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 580/1167] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Dec 15 16:09:58 2021] POST /identity/v3/domains => generated 267 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:00.923883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761142d-0390-4bef-9caf-986cf22fa319 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:00.924672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761142d-0390-4bef-9caf-986cf22fa319 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:00.924672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761142d-0390-4bef-9caf-986cf22fa319 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:00.926316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 588/1168] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:10:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:00.932463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:00.932910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:00.933003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:00.952312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:00.953564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:01.014103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 581/1169] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:10:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:01.038779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761142d-0390-4bef-9caf-986cf22fa319 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:01.052344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761142d-0390-4bef-9caf-986cf22fa319 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:01.057257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:01.058129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:01.058410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:01.058682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] PATH_INFO: `/v3/domains/a7e10a0f480f45159441c64b048eeb93` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:01.069792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a7e10a0f480f45159441c64b048eeb93)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:01.071746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb4ab-a04e-4446-b6dd-f67710750c9f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:01.073426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 589/1170] 10.222.0.30 () {56 vars in 1204 bytes} [Wed Dec 15 16:10:01 2021] GET /identity/v3/domains/a7e10a0f480f45159441c64b048eeb93 => generated 267 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:01.080026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:01.089368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782b04-0c50-422b-ad1b-9592441d77ff None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:01.095190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:01.095953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:01.096242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:01.096496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:01.097652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:01.099547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b202e-2d6b-4b0e-919f-95283a3800a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:01.129725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 582/1171] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:10:01 2021] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:03.497026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e417e-469d-45ec-9db7-cb50ab870900 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:03.497566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e417e-469d-45ec-9db7-cb50ab870900 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:03.497566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e417e-469d-45ec-9db7-cb50ab870900 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:03.499267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 590/1172] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:10:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:03.505411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:03.505853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:03.505952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:03.524478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:03.525796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:03.587480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 583/1173] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:10:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:03.614002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e417e-469d-45ec-9db7-cb50ab870900 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:03.628267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e417e-469d-45ec-9db7-cb50ab870900 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:03.634075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:03.634974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:03.635308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:03.635618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] PATH_INFO: `/v3/domains/a7e10a0f480f45159441c64b048eeb93` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:03.636950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a7e10a0f480f45159441c64b048eeb93)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:03.638911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de534446-4d64-4b93-bb92-bddb52ebdbbb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:03.640585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 591/1174] 10.222.0.30 () {56 vars in 1204 bytes} [Wed Dec 15 16:10:03 2021] GET /identity/v3/domains/a7e10a0f480f45159441c64b048eeb93 => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:03.647458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:03.657067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b30a3d-118d-4d1f-b916-b791e6746ff6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:03.663295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:03.663970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:03.664273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:03.664580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:03.665329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:03.667246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886a38-f947-4730-9f52-e8fbbd2038bd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:03.689390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 584/1175] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:10:03 2021] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:06.069214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e19-eab3-47e0-944e-3f95d42d7627 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.069820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e19-eab3-47e0-944e-3f95d42d7627 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.069820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e19-eab3-47e0-944e-3f95d42d7627 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.071534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 592/1176] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:10:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:06.077668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.078111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.078206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.097442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:06.098622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:06.106811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 585/1177] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:10:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:06.131208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3e19-eab3-47e0-944e-3f95d42d7627 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.144094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3e19-eab3-47e0-944e-3f95d42d7627 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.149463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.150256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.150532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.150800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.162871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:10:06.169591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:10:06.170752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 593/1178] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:10:06.177697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.187637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1777015-aa53-4cc3-916d-17dbbe0370c7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.194152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.194828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.195110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.195378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.196162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:06.196469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:06.198101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:06.207428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 586/1179] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:06.214392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.226018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2757-2ed3-4dc5-ae1b-cdee48d05c49 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.231686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.232613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.232898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.233171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] PATH_INFO: `/v3/users/2868ffcaa2db40cb99e2dcec26b9d194` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.248181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] RBAC: Authorizing `identity:get_user(user_id=2868ffcaa2db40cb99e2dcec26b9d194)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:06.250356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:06.252150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 594/1180] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/users/2868ffcaa2db40cb99e2dcec26b9d194 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:06.262294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.275793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245b80-3a6d-403c-8366-a8b8eb735034 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.284102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.284791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.285073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.285343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.294162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:06.295918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:06.305968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 587/1181] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:06.313299 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.324808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ea24-22f3-4bbd-b207-a3f254ddec54 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.330545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.331506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.331786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.332035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] PATH_INFO: `/v3/projects/ddd4f899cf954fcda17057d8f5f7b277` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.333410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] RBAC: Authorizing `identity:get_project(project_id=ddd4f899cf954fcda17057d8f5f7b277)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:06.335459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f497de-4f1b-414b-a7f6-d6d9b3a67183 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:06.337210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 595/1182] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/projects/ddd4f899cf954fcda17057d8f5f7b277 => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:06.344460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:06.355219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda5dea-6283-45c9-93b7-b6c1ecdd544b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:06.360806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:06.361527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:06.361809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:06.362077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:06.362932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=ddd4f899cf954fcda17057d8f5f7b277, user.id=2868ffcaa2db40cb99e2dcec26b9d194) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:06.363235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:06.365137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ab298-b414-43d0-9037-6dc578d73ea3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:06.371654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 588/1183] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:10:06 2021] GET /identity/v3/role_assignments?user.id=2868ffcaa2db40cb99e2dcec26b9d194&scope.project.id=ddd4f899cf954fcda17057d8f5f7b277&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:08.716317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce61c-9189-4073-b88a-04dae96a4c32 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.716944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce61c-9189-4073-b88a-04dae96a4c32 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.716944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce61c-9189-4073-b88a-04dae96a4c32 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.718642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 596/1184] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:10:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:08.725072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.725530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.725632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.745575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:08.746769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:08.756676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 589/1185] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:10:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:08.780104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce61c-9189-4073-b88a-04dae96a4c32 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:08.792899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce61c-9189-4073-b88a-04dae96a4c32 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:08.797637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:08.798407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.798678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.798939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.809183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:10:08.816111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:10:08.817384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 597/1186] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:10:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:10:08.824089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:08.834272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49ee5-392c-4802-8cee-29a68ba9f92e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:08.839852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:08.840559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.840842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.841115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.841884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:08.842187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:08.843789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:08.853374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 590/1187] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:10:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:08.860159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:08.871727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a9265-5ac9-46e5-a2b8-9f96a4b5aee6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:08.878007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:08.878886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.879233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.879505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] PATH_INFO: `/v3/users/2868ffcaa2db40cb99e2dcec26b9d194` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.880890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=2868ffcaa2db40cb99e2dcec26b9d194)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:08.886385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:08.886385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 598/1188] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:10:08 2021] GET /identity/v3/users/2868ffcaa2db40cb99e2dcec26b9d194 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:08.895231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:08.905316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae5c5-e1bd-4c70-826d-6770c4b34f98 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:08.910299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:08.911159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.911432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.911703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] PATH_INFO: `/v3/projects/ddd4f899cf954fcda17057d8f5f7b277` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.912928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ddd4f899cf954fcda17057d8f5f7b277)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:08.914986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a823a3-2d07-455a-9218-43a97bb628b6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:08.916697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 591/1189] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:10:08 2021] GET /identity/v3/projects/ddd4f899cf954fcda17057d8f5f7b277 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:08.923252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:08.935456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e74e-9636-417b-8379-84e683a7d8e0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:08.941798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:08.942689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:08.942953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:08.943235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] PATH_INFO: `/v3/projects/ddd4f899cf954fcda17057d8f5f7b277/users/2868ffcaa2db40cb99e2dcec26b9d194/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:08.945323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd4f899cf954fcda17057d8f5f7b277, user_id=2868ffcaa2db40cb99e2dcec26b9d194, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:08.947933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5294b0-af30-44b6-a64e-71ec66a1a3e9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:08.963373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 599/1190] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:10:08 2021] PUT /identity/v3/projects/ddd4f899cf954fcda17057d8f5f7b277/users/2868ffcaa2db40cb99e2dcec26b9d194/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:10:11.296378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebc59-99c3-438a-b28c-1d4daf8262db None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.296993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebc59-99c3-438a-b28c-1d4daf8262db None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.296993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebc59-99c3-438a-b28c-1d4daf8262db None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.298707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 592/1191] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:10:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:11.305847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.306391 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.306391 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.325310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:11.326517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:11.385686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 600/1192] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:10:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:11.410498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebc59-99c3-438a-b28c-1d4daf8262db None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.424907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebc59-99c3-438a-b28c-1d4daf8262db None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.430042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.430829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.431109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.431379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.442424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:10:11.449067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:10:11.450227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 593/1193] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:10:11.457095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.466614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fbb3c-d832-434d-af39-f1b6d41576b8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.473022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.473731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.474000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.474274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.475045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:11.475341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:11.477023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:11.486429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 601/1194] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:10:11.494312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.505556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1d48b-5da0-42c0-ab2f-d86a244382eb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.511116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.512028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.512306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.512638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] PATH_INFO: `/v3/users/2868ffcaa2db40cb99e2dcec26b9d194` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.513911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] RBAC: Authorizing `identity:get_user(user_id=2868ffcaa2db40cb99e2dcec26b9d194)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:11.516014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:11.517665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 594/1195] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/users/2868ffcaa2db40cb99e2dcec26b9d194 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:11.524206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.535050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcfe9-f59a-41f9-afc5-c9d0211f471c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.540766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.541413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.541697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.541964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.555496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:11.557324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:11.567876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 602/1196] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:11.574731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.589918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b6374-01fc-43f8-8f2c-fec4d71ada27 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.599275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.600158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.600451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.600740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] PATH_INFO: `/v3/projects/ddd4f899cf954fcda17057d8f5f7b277` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.602030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] RBAC: Authorizing `identity:get_project(project_id=ddd4f899cf954fcda17057d8f5f7b277)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:11.604147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8cef9-ae81-45ba-921a-a935185f0c28 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:11.605872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 595/1197] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/projects/ddd4f899cf954fcda17057d8f5f7b277 => generated 361 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:10:11.613660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:11.623441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692274-eac7-45e9-9d3f-c87343755e68 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:11.629101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:11.629763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:11.630036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:11.630301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:11.631125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=ddd4f899cf954fcda17057d8f5f7b277, user.id=2868ffcaa2db40cb99e2dcec26b9d194) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:11.631430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:11.633292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a8c6-55f1-49f6-96df-a65795ddb8d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:11.640080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 603/1198] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:10:11 2021] GET /identity/v3/role_assignments?user.id=2868ffcaa2db40cb99e2dcec26b9d194&scope.project.id=ddd4f899cf954fcda17057d8f5f7b277&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:11.352466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fc39-6d3e-4bcd-834b-8f9e4e6e219b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.352466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fc39-6d3e-4bcd-834b-8f9e4e6e219b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.352466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fc39-6d3e-4bcd-834b-8f9e4e6e219b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.355049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 596/1199] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:11.366680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.366680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.366680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.391166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:11.393659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:11.407715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 604/1200] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:11.454383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442fc39-6d3e-4bcd-834b-8f9e4e6e219b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.477566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442fc39-6d3e-4bcd-834b-8f9e4e6e219b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.485499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.486870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.487339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.487836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.501616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.503361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.528397 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:11.529688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 597/1201] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:11.536625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.548809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c671c6-abb8-439a-95f7-8590afb60ec7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.555896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.556707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.557022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.557357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.558199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:11.558642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.560310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851424-408e-41d8-968c-985a24494bc4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.584840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 605/1202] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:11.586826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.606104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643cc97-248d-4276-99d5-3fb6c45bb204 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.617494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.618736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.619277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.619852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.621403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.625110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2db3d2-4b52-43b0-aabc-4908ffb28bb7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.662554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 598/1203] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/users => generated 251 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:15.329817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33756-735e-4aa6-af54-5e3595d94bb2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.330394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33756-735e-4aa6-af54-5e3595d94bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.330394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33756-735e-4aa6-af54-5e3595d94bb2 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.332825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 606/1204] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:15.341360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.341913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.342506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.388715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:15.392280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.412457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 599/1205] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:15.440354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33756-735e-4aa6-af54-5e3595d94bb2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.460295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33756-735e-4aa6-af54-5e3595d94bb2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.468317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.469734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.470239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.470742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.492375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:15.499625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:11:15.501299 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 607/1206] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:15.508795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.524495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774c4b5-4e46-4e1d-a7d2-9c5b800ddc15 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.531957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.533023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.533459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.533918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.535237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:15.535752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.538683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.560487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 600/1207] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:15.565129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.575015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3f7-11eb-42d8-84ff-2ffd128bdf26 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.580706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.581621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.581885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.582155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.595262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.597717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.618721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:15.620454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 608/1208] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:15.630162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.647119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d24f-5516-448f-aec8-f80e43233f0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.653120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.654140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.654453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.654804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.655866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:15.656411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.658739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.677743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 601/1209] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:15.685175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.699490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0509-9621-4282-b0d4-cfbcebb89d3d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.705312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.706669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.707149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.707800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.716869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.718910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.738079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:15.741199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 609/1210] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:15.748622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.762028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a10e-8460-4e5f-97f1-8f7da4e4e1ba admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.766835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.768059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.768059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.768235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.769094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:15.769380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.771546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.794531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 602/1211] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:15.802096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.814789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a230e-ba3b-49f3-8a4b-a1063c5b9e2c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.821237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.822035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.822395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.822774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.833700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.835865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.849133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 610/1212] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:15.856907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.875263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd05c5-6db2-4ab1-a47e-89414c587396 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.885122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.886825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.887489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.887899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.905566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.907530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.929987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:15.932147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 603/1213] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:15.938877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.949099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ade8b-b19d-443f-ad92-8ba005078106 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.954979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.955838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.956155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.956495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.957425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:15.957911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.959875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.976847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 611/1214] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:15.984978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.003268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1732ea7-da80-403d-9ae9-d23e1fc8ede2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.012380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.013699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.014057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.014608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.026813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.029941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.054225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:16.055712 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 604/1215] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:16.063420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.075427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae147d5-3e24-4267-b6c4-a7a4e3188fb3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.083857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.085953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.087758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.087758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.088800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:16.089336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.093289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1314fac-80ba-43da-a173-331a3f9879ad admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.121133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 612/1216] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:16.130259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.146069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9bc4-4059-4ed0-b66e-3234b51c5333 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.152242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.152937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.153239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.153497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.154335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=33525026fd94484faca1657116086daf) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:16.154639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.156726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083077de-cbd6-4c78-930a-91bb587e35a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.174952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 605/1217] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/role_assignments?user.id=33525026fd94484faca1657116086daf&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:19.091039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904ed5-f793-43dd-aceb-a031a26fa0e4 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.092130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904ed5-f793-43dd-aceb-a031a26fa0e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.092689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904ed5-f793-43dd-aceb-a031a26fa0e4 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.095462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 613/1218] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:19.105824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.106488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.106488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.126000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:19.127605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:19.138574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 606/1219] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:19.171271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff904ed5-f793-43dd-aceb-a031a26fa0e4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.190795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff904ed5-f793-43dd-aceb-a031a26fa0e4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.197710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.198902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.199727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.199917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.216858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:19.226102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:11:19.228094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 614/1220] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:11:19.235999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.248084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec207c55-59a2-4f33-b645-f4939596ffa2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.254143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.255471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.255782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.256101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.256917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:19.257224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.259164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.271581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 607/1221] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:19.279355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.291995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60283111-7ebf-465d-b7eb-68a355cb82b8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.297737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.298733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.299017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.299329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.317432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.319374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.341594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:19.342995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 615/1222] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:11:19.351123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.363936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb57211-9b3a-45f3-ad39-91b3ce7c83f4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.370098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.370755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.371032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.371306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.372067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:19.372368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.374167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.390502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 608/1223] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:19.398146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.409997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb419a-dc7b-4520-b8fe-615a1c4a3f7d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.417095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.418069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.418373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.418625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.428005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.430155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.448220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:19.449806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 616/1224] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:19.456939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.468614 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c591c9-a397-4e5f-9756-ce62f51d3c7f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.473139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.473837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.474161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.474409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.475263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:19.475566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.477867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.500011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 609/1225] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:19.508168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.521644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4374a-c838-4395-95cb-28e1d7b11e57 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.526624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.527491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.527774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.528055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.540745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.542738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.564520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:19.565903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 617/1226] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:11:19.573748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.586171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a1e-d8fb-4cd7-a669-c4a726354c0f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.591468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.592327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.592529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.592769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.593563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:19.593870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.595703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.609984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 610/1227] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:19.616921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.629985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b35e8-eb0f-4795-914c-8dea8b767909 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.638764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.641180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.641783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.642283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.651107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.653097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.668030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:19.669368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 618/1228] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:19.681531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.698728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c5c1-df27-4dd1-af73-1f33d75f17cd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.714209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.714967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.715252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.715536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.716362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:19.716722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.718632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb5a19-6253-4caf-8b82-ba06a8e01079 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.734726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 611/1229] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:19.744314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.759918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01adfad-9008-4b5c-b867-9fa24930f359 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.768663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.770688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.771154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.771813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/33525026fd94484faca1657116086daf/roles/4b68546f04234f2385b96787ba0a9fc3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.797474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=33525026fd94484faca1657116086daf, role_id=4b68546f04234f2385b96787ba0a9fc3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.801854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429c0a8-7b43-4dc6-bf60-c3a2af068022 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.823737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 619/1230] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:11:19 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/33525026fd94484faca1657116086daf/roles/4b68546f04234f2385b96787ba0a9fc3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:22.430149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b863-60c7-4b0e-939d-39cb22c2518e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.430811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b863-60c7-4b0e-939d-39cb22c2518e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.430811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b863-60c7-4b0e-939d-39cb22c2518e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.432776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 612/1231] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:22.442436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.443068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.443346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.471472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:22.473461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:22.565642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 620/1232] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:22.595603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b863-60c7-4b0e-939d-39cb22c2518e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.612672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b863-60c7-4b0e-939d-39cb22c2518e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.621350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.622348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.622716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.623268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.639787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:22.649051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:11:22.650475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 613/1233] 10.222.0.30 () {56 vars in 1123 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:22.657860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.670189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e20ee3-054a-4714-8665-d24d54d19f39 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.676614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.677559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.677990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.678373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.679280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:22.679631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:22.682512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:22.696538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 621/1234] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:22.707045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.724445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585e606-b9c6-4f89-9a3a-e0a92df84cec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.730258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.731138 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.731413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.731677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.743205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:22.745451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:22.775057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:22.777055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 614/1235] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:22.786750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.802719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f86d5b-4996-493a-99cd-0ec7db8246ec admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.810750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.811856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.812341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.812898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.814342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:22.814905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:22.818046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:22.841166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 622/1236] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:22.849551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.866469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb17a-d630-4ad1-bce1-84b68c8a8adc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.872775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.873772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.874125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.874496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.890677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:22.893473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:22.919821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:22.921528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 615/1237] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:22.929499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:22.945117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a4aa9-dba3-4b4f-82f0-6a4a8d4641e7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:22.952939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:22.953936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:22.954414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:22.954901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:22.956194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:22.956645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:22.959670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:22.991906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 623/1238] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:22.999854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.014589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b606dbf-183e-46e2-916a-60656d4c1e77 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.019769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.020902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.021365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.021658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.032713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.035279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.047489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 616/1239] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:11:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:23.059721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.074890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0267b-bf5c-4d33-9aee-1accbf8dce03 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.081706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.082543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.083129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.083293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.095944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.097840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.119779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:23.121575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 624/1240] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:23.129163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.140697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089015-b6d6-40d1-9745-0bdae52ec3cc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.147129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.148094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.148519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.148969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.150077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:23.150418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.152267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.167609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 617/1241] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:23.174868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.194451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7ae7-c33d-46d2-abea-71a138f7ebed admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.201847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.202880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.203495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.203817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.216887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.220027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.239926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:23.241409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 625/1242] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:11:23.249067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.261770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e255f4-ec58-4ba2-84cd-380c3970fdb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.267191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.267933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.268251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.268648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.269718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:23.270120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.272646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bc0ab-5694-4368-83d5-26cf3beb99b7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.289611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 618/1243] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:23.297310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:23.314816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc21531-3f0d-45ef-b6ae-bc0fce5dcd51 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:23.322133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:23.322802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:23.323084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:23.323403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:23.324374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] RBAC: Adding query filter params (role.id=4b68546f04234f2385b96787ba0a9fc3, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=33525026fd94484faca1657116086daf) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:23.324724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:23.326667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77d1e2-f39d-419b-a693-c3185cbe009f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:23.334363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 626/1244] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:11:23 2021] GET /identity/v3/role_assignments?user.id=33525026fd94484faca1657116086daf&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=4b68546f04234f2385b96787ba0a9fc3 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:26.236619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050916-6c1c-42d0-b29c-6ae8d01759ea None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.237474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050916-6c1c-42d0-b29c-6ae8d01759ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.237474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050916-6c1c-42d0-b29c-6ae8d01759ea None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.239318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 619/1245] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:26.245939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.246546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.246546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.267601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:26.269039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:26.278155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 627/1246] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:26.313314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050916-6c1c-42d0-b29c-6ae8d01759ea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.328022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050916-6c1c-42d0-b29c-6ae8d01759ea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.333981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.335005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.335343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.335796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.360174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:26.369657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:11:26.371185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 620/1247] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:26.378972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.391076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98f29-eb9e-4301-92e3-f8c3b3dc7526 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.397454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.398221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.398594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.398900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.399660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.399966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.401605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.411120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 628/1248] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:26.421551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.438811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036804bc-a057-418c-b120-e165ac8afac9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.446778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.448149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.448559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.448849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.463345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.466399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.496720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:26.498546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 621/1249] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:26.505588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.516559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422969-3e57-4870-a3c7-c6b229baf68b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.522065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.522742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.523014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.523280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.524020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.524314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.525974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.539374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 629/1250] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:26.546602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.561277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f360-cdc9-4ff2-a612-f61c5d34b2cc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.568903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.570382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.570786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.571205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.586548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.589921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.615725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:26.624009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 622/1251] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:26.626167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.643542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aae6-eeeb-4e42-8be4-ad9b5f88de40 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.651834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.653145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.653646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.654266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.655785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.656262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.659939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.698475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 630/1252] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:26.699908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.713777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c14-61c8-4768-bb73-5c15fd476a24 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.719087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.719799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.720086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.720525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.732762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.735319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.751288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 623/1253] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:26.759405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.773116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49bde-d85a-4f95-8f65-31ae13753d52 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.779198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.780179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.780599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.780877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.795367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.797774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.822119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:26.823509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 631/1254] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:26.830745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.841864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3bf9e-cc4c-4f0a-9206-317382ec9392 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.847336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.848095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.848476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.848771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.850262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.850601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.852617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.870674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 624/1255] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:26.876155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.888261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71d2e-9e9c-4810-a092-55ec7527bcc8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.893788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.894525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.894874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.895457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.906646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.908657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.922196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:26.923399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 632/1256] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:26.930091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.940232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5901ae-78f7-4f69-bcf7-576302396eb5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.945490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.946573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.947078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.947569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.948499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.948812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.950764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9ac5-c793-4a35-b339-e004d8120202 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:26.965141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 625/1257] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:26.971979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:26.983543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7453d3-a9d5-40ff-85b9-539252afd008 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:26.988488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:26.989247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:26.989568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:26.989850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:26.990694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=33525026fd94484faca1657116086daf) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:26.990992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:26.992886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75517f95-6e09-4c53-a8a1-d74e6555bfae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:27.012463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 633/1258] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:11:26 2021] GET /identity/v3/role_assignments?user.id=33525026fd94484faca1657116086daf&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:29.502196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec43e-f120-450b-9efb-fd6561de040f None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.502773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec43e-f120-450b-9efb-fd6561de040f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.502773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec43e-f120-450b-9efb-fd6561de040f None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.505515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 626/1259] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:29.513250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.513908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.513908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.535889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:29.537672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:29.546524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 634/1260] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:29.572975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec43e-f120-450b-9efb-fd6561de040f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.586046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec43e-f120-450b-9efb-fd6561de040f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.590227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.591024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.591299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.591570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.603395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:29.610320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:11:29.611738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 627/1261] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:29.618773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.629404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325f5f-9f53-4ccd-a912-754cd5127d6e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.634760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.635534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.635937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.636316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.637256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:29.637643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.639379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.650849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 635/1262] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:29.659619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.674878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0adb4-0455-4ed6-a8a6-b5fff7489b99 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.681548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.682591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.682980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.683364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.696988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.699124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.725382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:29.727954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 628/1263] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:29.735473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.748406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408ff4-162d-42b0-afe3-ac6d54541f97 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.754569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.755589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.755965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.756532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.757374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:29.757761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.759718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.782013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 636/1264] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:29.788658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.799642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9911d-a0b1-4d8e-9ed9-22f619046aaf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.804863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.805737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.806045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.806344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.820953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.823002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.838969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:29.840227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 629/1265] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:29.847591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.860331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ae14-f5fa-46b8-9af3-49d8fab8d657 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.866371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.867280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.867563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.867837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.868747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:29.869053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.871849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.894213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 637/1266] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:29.902554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.915158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40c439-4ff7-4d25-a6d4-f9f1430c29c4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.923261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:29.924189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:29.924687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:29.925033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:29.937554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:29.940298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:29.963124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:29.964580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 630/1267] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:29.972169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:29.985787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc2fd-500f-4968-a1e1-73b1c3dd1b32 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:29.999425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:30.000222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:30.000656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:30.001083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:30.001986 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:30.002419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:30.005016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:30.023850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 638/1268] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:30.032574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:30.050522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be407-34e5-46df-8000-636af051a9cc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:30.059713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:30.061230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:30.061561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:30.062066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:30.073207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:30.075780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:30.091780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:30.093086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 631/1269] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:30.102573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:30.113385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0c78-581d-431f-b263-1bf90d5e9400 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:30.119011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:30.119717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:30.119994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:30.120258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:30.121112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:30.121419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:30.123306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ec67a-36c5-449c-b4f8-a3f9949da3a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:30.138407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 639/1270] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:30.145610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:30.158207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804e92-44d7-4a6b-ac34-6586257650f9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:30.164150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:30.165214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:30.165531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:30.165810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] PATH_INFO: `/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/33525026fd94484faca1657116086daf/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:30.168664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] RBAC: Authorizing `identity:create_grant(project_id=400084fc2d6d496ab8e7710a0fa73c3f, user_id=33525026fd94484faca1657116086daf, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:30.171961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284baf5-0752-4105-9bf3-32b1f4bd799a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:30.190803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 632/1271] 10.222.0.30 () {58 vars in 1460 bytes} [Wed Dec 15 16:11:30 2021] PUT /identity/v3/projects/400084fc2d6d496ab8e7710a0fa73c3f/users/33525026fd94484faca1657116086daf/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:32.706667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ecede-665d-43b1-b0ef-0913a139ea23 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.707506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ecede-665d-43b1-b0ef-0913a139ea23 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.707506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ecede-665d-43b1-b0ef-0913a139ea23 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.709078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 640/1272] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:32.715858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.716680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.716680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.739244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:32.740689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:32.816051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 633/1273] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:32.842044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ecede-665d-43b1-b0ef-0913a139ea23 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:32.859517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ecede-665d-43b1-b0ef-0913a139ea23 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:32.865184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:32.866190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.866767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.867061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.880559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:11:32.887363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:11:32.888596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 641/1274] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Dec 15 16:11:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:11:32.900880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:32.919015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27311c2-0bed-40a6-9ee6-51844078fdf9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:32.924996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:32.925757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.926104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.926443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.927392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:32.927693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:32.929351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:32.938845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 634/1275] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Dec 15 16:11:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:32.945360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:32.955748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3850f7-7508-420c-ada4-c3e1c41b3fac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:32.960805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:32.961533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.961784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.962049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.975134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:32.977387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:32.995972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:32.997237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 642/1276] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:33.004169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.016543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d5c5-f8ce-483e-841f-34e079e92bce admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.022635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.023421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.023692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.023960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.024833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.025141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.026882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.042634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 635/1277] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:33.050151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.065022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2279-2d24-428d-9b19-86626a0a6244 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.070083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.070935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.071242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.071505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.080232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.082322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.099630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:11:33.100910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 643/1278] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:33.110310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.121497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a39d2-c8fa-4c98-8466-cb566d4f6ad3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.126311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.127014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.127291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.127559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.128415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.128746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.130705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.149618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 636/1279] 10.222.0.30 () {56 vars in 1164 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:33.158512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.171732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec46a-247f-4e88-9220-b554136c9cd2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.177003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.177928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.178210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.178808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.188998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.191238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.205147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 644/1280] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:33.214170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.232595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5fc8f-3160-48dc-ba31-13b8b62c8699 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.238299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.239348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.239676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.239980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.254100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.256988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.278151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:11:33.279802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 637/1281] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:33.287602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.300611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8907-e5a5-4c7c-9406-e62a85ec19a1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.307157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.308040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.308525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.309163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.309962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.310358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.312615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.338996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 645/1282] 10.222.0.30 () {56 vars in 1130 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:33.340673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.357902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7909-54ca-4e91-b9c5-82806176a699 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.363773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.364751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.365319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.365743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.374469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.376488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.393114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:11:33.394525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 638/1283] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:33.405736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.422401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b43b-ac33-4928-ac80-c22fc4f102c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.429461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.430142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.430428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.430811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.432648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.433087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.435467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640450-75e0-47ff-94f6-014981390ba1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.449554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 646/1284] 10.222.0.30 () {56 vars in 1169 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:33.456536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.468205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962544f-4286-44be-8414-812b3cd30ed0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.474075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.475242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.475568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.475932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.477387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] RBAC: Adding query filter params (role.id=5f760d89f7794814b25f104c56fc0fcb, scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f, user.id=33525026fd94484faca1657116086daf) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.477726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.479760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d384cda-4d06-43ed-9802-83a37e9fd9f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.487686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 639/1285] 10.222.0.30 () {56 vars in 1395 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/role_assignments?user.id=33525026fd94484faca1657116086daf&scope.project.id=400084fc2d6d496ab8e7710a0fa73c3f&role.id=5f760d89f7794814b25f104c56fc0fcb => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:36.148418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebf3f-2b70-40b1-b433-53220fcb5ae6 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.149065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebf3f-2b70-40b1-b433-53220fcb5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.149065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebf3f-2b70-40b1-b433-53220fcb5ae6 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.150771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 647/1286] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:36.157731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.158269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.158269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.177422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:36.178991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.190219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 640/1287] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:36.223395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ebf3f-2b70-40b1-b433-53220fcb5ae6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.241173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ebf3f-2b70-40b1-b433-53220fcb5ae6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.246312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.247092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.247424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.247642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.248513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.250285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.263135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:11:36.264487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 648/1288] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:11:36 2021] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:36.277076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.287514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2079bf9-e90c-4a4f-999c-8de7e1dfddec None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.292737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.293453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.293758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.294005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.294819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:36.295156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.296961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493412-fab1-4f1f-9954-f2784c5c9ecf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.302998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 641/1289] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Dec 15 16:11:36 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:36.309440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.321831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942dae-affa-4c65-9bed-1b0f1622841f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.326741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.327412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.327687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.327927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.328700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:36.329004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.330609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ded7c-9e46-428c-9f94-793938b1c3cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.335830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 649/1290] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Dec 15 16:11:36 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:39.118383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a656-d0ed-4ffc-a13f-d8d45df70ff7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.118933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a656-d0ed-4ffc-a13f-d8d45df70ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.118933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a656-d0ed-4ffc-a13f-d8d45df70ff7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.120917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 642/1291] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:39.129355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-88d0-4e0f-a777-a45c14a9e820 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.129850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-88d0-4e0f-a777-a45c14a9e820 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.129949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-88d0-4e0f-a777-a45c14a9e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.151978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e642dddb-88d0-4e0f-a777-a45c14a9e820 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:39.153271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e642dddb-88d0-4e0f-a777-a45c14a9e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.162639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 650/1292] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:39.189010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a656-d0ed-4ffc-a13f-d8d45df70ff7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:39.205921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a656-d0ed-4ffc-a13f-d8d45df70ff7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:39.213432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:39.214324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.214651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.214962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.215807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:39.217591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db15dc-4689-416e-a79b-f45bae100ae1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:39.248480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 643/1293] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Dec 15 16:11:39 2021] POST /identity/v3/services => generated 246 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:41.716523 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ef2f-bffc-4d9f-9668-cd8da9a6bc15 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.717116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ef2f-bffc-4d9f-9668-cd8da9a6bc15 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.717116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ef2f-bffc-4d9f-9668-cd8da9a6bc15 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.718903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 651/1294] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:41.724849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.725311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.725435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.745514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:41.746740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:41.767373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 644/1295] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:41 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:41.792770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1ef2f-bffc-4d9f-9668-cd8da9a6bc15 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.807646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1ef2f-bffc-4d9f-9668-cd8da9a6bc15 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.812662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.813456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.813741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.814017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.814687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.816283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.827510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:11:41.828697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 652/1296] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:41.835575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.844980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea4ef-f4ce-4749-bfa9-2f0ad2edfd91 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.850884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.851543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.851817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.852083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.853141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:41.853442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.855029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.860871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 645/1297] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:41.867637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.877806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd447-6e13-4ea8-b65f-345fec429aa1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.883571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.884207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.884473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.884760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.885547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] RBAC: Adding query filter params (interface=public, service_id=e42525857006418fadc2ca4deda2c5fd, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:41.885889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.887496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efaba-5d9a-4ab1-8a2e-327c9d41f69c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.893081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 653/1298] 10.222.0.30 () {56 vars in 1272 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/endpoints?service_id=e42525857006418fadc2ca4deda2c5fd&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:41.899546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.909583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da00a-6bb4-403d-b681-565aa03e81d6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.914665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.915325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.915604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.915882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.916628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.918220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f857c-801f-4453-89f6-b255cd26fdf8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.925656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 646/1299] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:44.321033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974790f9-c335-449e-8e81-82a553f0ccdf None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.321618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974790f9-c335-449e-8e81-82a553f0ccdf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.321618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974790f9-c335-449e-8e81-82a553f0ccdf None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.323314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 654/1300] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:11:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:44.329510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.329991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.330115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.348974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:44.350872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.359742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 647/1301] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:11:44 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:44.384130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974790f9-c335-449e-8e81-82a553f0ccdf None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.396950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974790f9-c335-449e-8e81-82a553f0ccdf None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.401729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.402508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.402787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.403055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.403704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.405322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.416713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:11:44.417880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 655/1302] 10.222.0.30 () {56 vars in 1138 bytes} [Wed Dec 15 16:11:44 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:11:44.425007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.434401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474fc7-fce2-4f73-ba30-039981feb8e2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.439498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.440151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.440447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.440744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.441466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:44.441769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.443407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03929fa-25bc-432a-8cab-2af6acc19284 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.448767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 648/1303] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Dec 15 16:11:44 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:44.455154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.466377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908257c-d68c-4e50-ac01-db82418271df admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.472161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.472834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.473115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.473383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.474347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.476081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1628ef-300e-4c2f-bac4-6050ddca05d0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.496240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 656/1304] 10.222.0.30 () {60 vars in 1165 bytes} [Wed Dec 15 16:11:44 2021] POST /identity/v3/endpoints => generated 331 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:50.859723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:50.859723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:50.859723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:50.871070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 649/1305] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:12:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:12:50.873397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717e91-5610-4a4a-b01d-3bc895bf067a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:50.874086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717e91-5610-4a4a-b01d-3bc895bf067a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:50.874086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717e91-5610-4a4a-b01d-3bc895bf067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:51.033413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-93717e91-5610-4a4a-b01d-3bc895bf067a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:51.035552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-93717e91-5610-4a4a-b01d-3bc895bf067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:51.193237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 657/1306] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:12:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:51.204701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:51.207981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:51.356559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e818b5-9fdf-4a67-bf87-b053257f5776 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:51.474006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:51.474727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:51.475009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:51.475294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:51.476083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:51.478486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1813-0c51-4de0-8203-284fc1fcf87a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:51.521070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 650/1307] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:12:51 2021] GET /identity/v3/projects => generated 2553 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:54.136549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c956-7e07-4f82-93c6-a956cef84080 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:54.137165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c956-7e07-4f82-93c6-a956cef84080 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:54.137517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c956-7e07-4f82-93c6-a956cef84080 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:54.141202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 658/1308] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:12:54 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:12:54.151081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f797c-0418-454e-b48d-8bec3bad7b01 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:54.151865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f797c-0418-454e-b48d-8bec3bad7b01 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:54.152021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f797c-0418-454e-b48d-8bec3bad7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:54.262532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-db6f797c-0418-454e-b48d-8bec3bad7b01 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:54.263783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-db6f797c-0418-454e-b48d-8bec3bad7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:54.390806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 651/1309] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:12:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:54.464159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:54.464629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:54.465018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:54.467259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 659/1310] 10.222.0.30 () {54 vars in 964 bytes} [Wed Dec 15 16:12:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:12:54.477593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bd780-de8c-4833-b088-bf8e357d6f14 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:54.478501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bd780-de8c-4833-b088-bf8e357d6f14 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:54.479106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bd780-de8c-4833-b088-bf8e357d6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:54.584376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8a2bd780-de8c-4833-b088-bf8e357d6f14 None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:54.585708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8a2bd780-de8c-4833-b088-bf8e357d6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:54.697540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 652/1311] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Dec 15 16:12:54 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:54.707688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:54.710470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:54.829329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b726c-6ce8-4cd9-9177-6ea6921b9d21 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:54.911593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:54.912170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:54.912510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:54.912749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:54.914418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:55.035577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:55.037246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a5612-90f1-416b-9799-4053cbdc2edf service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:55.067588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 660/1312] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:57.806138 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:57.806693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:57.806693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:57.808824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 653/1313] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:12:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:12:57.815779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a475d6-7333-4df9-b309-cc3bd7ebb2e0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:57.816363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a475d6-7333-4df9-b309-cc3bd7ebb2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:57.816363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a475d6-7333-4df9-b309-cc3bd7ebb2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:57.896575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-84a475d6-7333-4df9-b309-cc3bd7ebb2e0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:57.897829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-84a475d6-7333-4df9-b309-cc3bd7ebb2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:58.001543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 661/1314] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:12:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:58.042679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:58.044202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:58.164532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29397-44a4-4d6a-b26c-e65745419e08 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:58.253296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:58.254137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:58.254539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:58.254959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:58.257042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:58.389157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:58.390863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0437e8f-8807-4d43-ac42-e039e088b3ab service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:58.414904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 654/1315] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:01.313873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:01.314469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:01.314469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:01.316269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 662/1316] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:01.323516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:01.324035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:01.324035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:01.397057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:01.398332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:01.495383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 655/1317] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:01.532079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:01.533686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:01.669884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018aed-18cb-4557-8233-ef13ae5cd4de None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:01.773308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:01.774189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:01.774513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:01.774756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:01.786081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:01.788154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156896-6eb4-4620-9be4-cefa258a017a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:01.790045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 663/1318] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:13:01 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:13:01.803512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:01.804934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:01.903513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ff61e-ec10-4c8d-94e2-ac73423328b9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:01.976168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:01.976759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:01.977036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:01.977305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:01.979075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:02.100992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:02.102567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d7d37-4140-472e-bf4e-af937afc03c3 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:02.122998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 656/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:05.125501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:05.126544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:05.126544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:05.127848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 664/1320] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:05.134047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e775a-6d64-4c4b-a7d0-4b493a815184 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:05.134621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e775a-6d64-4c4b-a7d0-4b493a815184 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:05.134621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e775a-6d64-4c4b-a7d0-4b493a815184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:05.214204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-758e775a-6d64-4c4b-a7d0-4b493a815184 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:05.216253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-758e775a-6d64-4c4b-a7d0-4b493a815184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:05.325426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 657/1321] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:05.362120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:05.363708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:05.498164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00496f2-ca58-4e0d-8ae3-c6cefcf92dcb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:05.597215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:05.598088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:05.598557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:05.598979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:05.611264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:05.613386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d942a-c367-44b8-9880-600bfd943b1b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:05.615185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 665/1322] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:13:05 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:13:05.648352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:05.648641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:05.648921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:05.650803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 658/1323] 10.222.0.30 () {54 vars in 964 bytes} [Wed Dec 15 16:13:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:05.657599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232b25-a2f2-4a9f-8745-e6aeee4a2c4d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:05.657887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232b25-a2f2-4a9f-8745-e6aeee4a2c4d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:05.658165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232b25-a2f2-4a9f-8745-e6aeee4a2c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:05.736217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6d232b25-a2f2-4a9f-8745-e6aeee4a2c4d None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:05.737459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6d232b25-a2f2-4a9f-8745-e6aeee4a2c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:05.813208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 666/1324] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Dec 15 16:13:05 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:05.823049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:05.824697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:05.935522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88fdd8-6ed1-41e5-ba4f-b10c0995fea0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:06.024528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058100de-094d-4846-9606-8474665c3434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:06.025235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058100de-094d-4846-9606-8474665c3434 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:06.025511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058100de-094d-4846-9606-8474665c3434 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:06.025777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058100de-094d-4846-9606-8474665c3434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:06.027509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-058100de-094d-4846-9606-8474665c3434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:06.153837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058100de-094d-4846-9606-8474665c3434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:06.155304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058100de-094d-4846-9606-8474665c3434 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:06.175718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 659/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:13:09.730353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:09.730969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:09.730969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:09.733081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 667/1326] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:09.739794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008776f-26f6-4e15-a942-d50b2b436bf0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:09.740414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008776f-26f6-4e15-a942-d50b2b436bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:09.740414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008776f-26f6-4e15-a942-d50b2b436bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:09.836020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2008776f-26f6-4e15-a942-d50b2b436bf0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:09.837316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2008776f-26f6-4e15-a942-d50b2b436bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:09.947833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 660/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:09.988650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:09.990269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:10.105445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1bcd-8b86-4761-80ce-4e3064220848 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:10.183871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:10.184557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:10.184838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:10.185094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:10.186738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:10.300620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:10.301997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee07da-a967-4c50-99d4-174f21021d0d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:10.320782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 668/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:13:12.776644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:12.777214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:12.777214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:12.778984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 661/1329] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:12.785482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a647-829f-4940-a97a-2c10d24ddba3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:12.785956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a647-829f-4940-a97a-2c10d24ddba3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:12.786218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a647-829f-4940-a97a-2c10d24ddba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:12.858334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3e70a647-829f-4940-a97a-2c10d24ddba3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:12.859524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3e70a647-829f-4940-a97a-2c10d24ddba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:12.972594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 669/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:13.013866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:13.015529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:13.128888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe452721-f2b1-4ff9-9017-8b1e563c3eff None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:13.206654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:13.207308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.207588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.207866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.209518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:13.320500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:13.321997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd16d-525c-4596-81db-f10c25565534 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:13.342063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 662/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:15.951561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.952225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.952419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.955317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 670/1332] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:15.962142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.962720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.962720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.048861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:16.050101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.178461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 663/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:16.218598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:16.220079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.412573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d587e-b681-4bea-bb2d-88338fd4cdbe None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:16.533005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:16.533877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.534161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.534440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] PATH_INFO: `/v3/projects/4cd7b955df6e4eb192e35637959278aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.546882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cd7b955df6e4eb192e35637959278aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:16.549022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3242d-2688-4675-892d-f15b2c36e506 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.551096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 671/1334] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Dec 15 16:13:16 2021] GET /identity/v3/projects/4cd7b955df6e4eb192e35637959278aa => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:13:16.565107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:16.566412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.667117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859ed5-2a6a-45a6-9992-73958a429060 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:16.762791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:16.763342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.763622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.763892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.765590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.884550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:16.886035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760827-325f-462b-b205-d3f3bd4a06e4 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.906000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 664/1335] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:19.705861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:19.706441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:19.706441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:19.708245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 672/1336] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:19.716013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7402a-b08f-49a4-b20a-cfa263dc9fb2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:19.716578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7402a-b08f-49a4-b20a-cfa263dc9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:19.717005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7402a-b08f-49a4-b20a-cfa263dc9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:19.798701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-79e7402a-b08f-49a4-b20a-cfa263dc9fb2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:19.799928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-79e7402a-b08f-49a4-b20a-cfa263dc9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:19.903788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 665/1337] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:19.941446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:19.942992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:20.057966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530a4c-da2a-4315-ba49-3841277b92aa None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:20.143149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:20.143826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:20.144105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:20.144376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:20.146260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:20.285949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:20.287456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32763da-0de5-44f0-90f8-3cefdd5e8244 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:20.310618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 673/1338] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:22.844602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:22.845166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:22.845166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:22.846971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 666/1339] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:22.853688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370399d8-0ea2-4440-b886-004942b9ec8a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:22.854258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370399d8-0ea2-4440-b886-004942b9ec8a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:22.854258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370399d8-0ea2-4440-b886-004942b9ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:22.944927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-370399d8-0ea2-4440-b886-004942b9ec8a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:22.946536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-370399d8-0ea2-4440-b886-004942b9ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:23.057183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 674/1340] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:23.102130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:23.104636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:23.212178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38985543-bb94-43b8-a0a6-8a22a533bbea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:23.216039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:23.216811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:23.217094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:23.217366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:23.226614 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:23.228155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772953fe-1882-4915-9ee7-2f538c614f6b service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:23.237761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 667/1341] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:26.158123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d58da-973f-413a-b515-f908e3abff7f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:26.158687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d58da-973f-413a-b515-f908e3abff7f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:26.158687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d58da-973f-413a-b515-f908e3abff7f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:26.160473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 675/1342] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:13:26.167398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727422-c186-434f-8b46-5b43f44fda89 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:26.167976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727422-c186-434f-8b46-5b43f44fda89 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:26.167976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73727422-c186-434f-8b46-5b43f44fda89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:26.189155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-73727422-c186-434f-8b46-5b43f44fda89 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:26.190360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-73727422-c186-434f-8b46-5b43f44fda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:26.202267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 668/1343] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:26.241386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d58da-973f-413a-b515-f908e3abff7f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:26.243857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-085d58da-973f-413a-b515-f908e3abff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:26.259802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d58da-973f-413a-b515-f908e3abff7f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:26.264086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:26.264772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:26.265052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:26.265328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:26.276159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:26.277674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670cb13-a106-48cc-b205-26d0edb14125 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:26.287902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 676/1344] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:30.815380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122995-0b56-4534-9e92-7e193adfb2d9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:30.815960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122995-0b56-4534-9e92-7e193adfb2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:30.815960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122995-0b56-4534-9e92-7e193adfb2d9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:30.817874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 669/1345] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:30.824663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145efef-94cb-4821-9008-55eb019848d8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:30.825409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145efef-94cb-4821-9008-55eb019848d8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:30.825409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145efef-94cb-4821-9008-55eb019848d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:30.847417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0145efef-94cb-4821-9008-55eb019848d8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:30.848704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0145efef-94cb-4821-9008-55eb019848d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:30.857292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 677/1346] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:30.899071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122995-0b56-4534-9e92-7e193adfb2d9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:30.911510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122995-0b56-4534-9e92-7e193adfb2d9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:30.915810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:30.916538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:30.916810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:30.917119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:30.927472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:30.929220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4afe3d-2171-4944-9e04-8f27d055805f service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:30.939709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 670/1347] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:33.969685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ac6e-3281-401a-bcdb-5abf17e9cdb8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:33.970330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ac6e-3281-401a-bcdb-5abf17e9cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:33.970330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ac6e-3281-401a-bcdb-5abf17e9cdb8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:33.971998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 678/1348] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:33.979059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d983c-3fd1-447f-9573-8d721de81148 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:33.979656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d983c-3fd1-447f-9573-8d721de81148 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:33.979656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d983c-3fd1-447f-9573-8d721de81148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:33.999905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-771d983c-3fd1-447f-9573-8d721de81148 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:34.001135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-771d983c-3fd1-447f-9573-8d721de81148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:34.010393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 671/1349] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:34.049471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ac6e-3281-401a-bcdb-5abf17e9cdb8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:34.062310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ac6e-3281-401a-bcdb-5abf17e9cdb8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:34.066608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:34.067293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:34.067573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:34.067852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:34.079041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:34.080525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde427-f2b7-4c2b-a5d2-470c05c8016c service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:34.090947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 679/1350] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:39.001110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3a83-26ac-48a6-ad98-5851c3a5324e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:39.001648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3a83-26ac-48a6-ad98-5851c3a5324e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:39.001648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3a83-26ac-48a6-ad98-5851c3a5324e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:39.003317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 672/1351] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:39.010095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40bc9-ca3b-49c2-9867-73176805bed5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:39.010643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40bc9-ca3b-49c2-9867-73176805bed5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:39.010734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40bc9-ca3b-49c2-9867-73176805bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:39.030073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-70c40bc9-ca3b-49c2-9867-73176805bed5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:39.031321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-70c40bc9-ca3b-49c2-9867-73176805bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:39.040586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 680/1352] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:39.080995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3a83-26ac-48a6-ad98-5851c3a5324e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:39.096114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3a83-26ac-48a6-ad98-5851c3a5324e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:39.100150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:39.101692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:39.101906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:39.102167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:39.112841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:39.114348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299f73-5def-48fe-b650-683ef927987b service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:39.128466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 673/1353] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:44.257611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12980b9-a66d-44bf-991c-798d936cbb8b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:44.258464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12980b9-a66d-44bf-991c-798d936cbb8b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:44.258887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12980b9-a66d-44bf-991c-798d936cbb8b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:44.262258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 681/1354] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:13:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:44.269730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e8c0-2d6e-4df0-9ec9-57e91143b568 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:44.270642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e8c0-2d6e-4df0-9ec9-57e91143b568 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:44.271151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e8c0-2d6e-4df0-9ec9-57e91143b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:44.369715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-20b3e8c0-2d6e-4df0-9ec9-57e91143b568 None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:44.371323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-20b3e8c0-2d6e-4df0-9ec9-57e91143b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:44.461598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 674/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:13:44 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:49.256298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37244c-254a-4c90-b54f-ff9c3febe400 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:49.256863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37244c-254a-4c90-b54f-ff9c3febe400 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:49.256863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37244c-254a-4c90-b54f-ff9c3febe400 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:49.258995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 682/1356] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:13:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:49.264745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-8f8c-4340-84b4-7e23b36c52cd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:49.265396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-8f8c-4340-84b4-7e23b36c52cd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:49.265396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-8f8c-4340-84b4-7e23b36c52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:49.285674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b1463901-8f8c-4340-84b4-7e23b36c52cd None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:49.286835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b1463901-8f8c-4340-84b4-7e23b36c52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:49.295997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 675/1357] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:13:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:50.847430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397f0eb-7716-4b60-847a-ebd9b0962b9d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:50.848907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397f0eb-7716-4b60-847a-ebd9b0962b9d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:50.849428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397f0eb-7716-4b60-847a-ebd9b0962b9d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:50.852930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 683/1358] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:13:50 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:50.862523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769313f-e6c8-4e87-9f34-f18a0b42f412 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:50.863121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769313f-e6c8-4e87-9f34-f18a0b42f412 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:50.863306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769313f-e6c8-4e87-9f34-f18a0b42f412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:50.885230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7769313f-e6c8-4e87-9f34-f18a0b42f412 None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:50.886535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7769313f-e6c8-4e87-9f34-f18a0b42f412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:50.896961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 676/1359] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:13:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:55.214739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6829-52e4-4e3e-9e6d-1a8fac015117 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:55.215514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6829-52e4-4e3e-9e6d-1a8fac015117 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:55.215670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6829-52e4-4e3e-9e6d-1a8fac015117 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:55.217591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 684/1360] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:55.223903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d957-d203-4279-90c7-8485406c2a1c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:55.225097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d957-d203-4279-90c7-8485406c2a1c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:55.225451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d957-d203-4279-90c7-8485406c2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:55.252270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9e10d957-d203-4279-90c7-8485406c2a1c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:55.254489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9e10d957-d203-4279-90c7-8485406c2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:55.268274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 677/1361] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:55.336765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3129a-123f-4b79-a0f0-6844a758eaed None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:55.337071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3129a-123f-4b79-a0f0-6844a758eaed None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:55.338165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3129a-123f-4b79-a0f0-6844a758eaed None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:55.340359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 685/1362] 10.222.0.30 () {54 vars in 961 bytes} [Wed Dec 15 16:13:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:55.349282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2265e-b869-4857-8f40-4b4acc9bb7e0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:55.349760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2265e-b869-4857-8f40-4b4acc9bb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:55.350508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2265e-b869-4857-8f40-4b4acc9bb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:55.438276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cce2265e-b869-4857-8f40-4b4acc9bb7e0 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:55.440215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cce2265e-b869-4857-8f40-4b4acc9bb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:55.585143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 678/1363] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Dec 15 16:13:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:55.594395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3129a-123f-4b79-a0f0-6844a758eaed None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:55.616846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3129a-123f-4b79-a0f0-6844a758eaed None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:55.625506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:55.627146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:55.627755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:55.628411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:55.643693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:55.647654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb6b71-fd3b-4f61-8aba-6572c141a0e8 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:55.666371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 686/1364] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:13:58.569755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d6af-2b25-4708-a5d2-dd99a42faf27 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:58.570650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d6af-2b25-4708-a5d2-dd99a42faf27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:58.570650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d6af-2b25-4708-a5d2-dd99a42faf27 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:58.572517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 679/1365] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:13:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:13:58.579697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528792-daf6-4526-9166-8c619f9c1f1a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:58.580221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528792-daf6-4526-9166-8c619f9c1f1a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:58.580654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528792-daf6-4526-9166-8c619f9c1f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:58.608684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-af528792-daf6-4526-9166-8c619f9c1f1a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:58.610712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af528792-daf6-4526-9166-8c619f9c1f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:58.625088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 687/1366] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:58.687362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2d6af-2b25-4708-a5d2-dd99a42faf27 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:58.708786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2d6af-2b25-4708-a5d2-dd99a42faf27 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:58.714368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:58.715207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:58.715555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:58.715884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:58.726128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:58.727699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b182b96-ed8d-43c6-9484-6fd9c9477d64 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:58.738958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 680/1367] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:01.547496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f7-df8c-4640-9c3f-265d0f3b0de1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.548077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f7-df8c-4640-9c3f-265d0f3b0de1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.548077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f7-df8c-4640-9c3f-265d0f3b0de1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.549886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 688/1368] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:01.556857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0b5d7-e363-479a-8f48-b80f1f783c21 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.557968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0b5d7-e363-479a-8f48-b80f1f783c21 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.558297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0b5d7-e363-479a-8f48-b80f1f783c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.604866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a8c0b5d7-e363-479a-8f48-b80f1f783c21 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:01.606032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8c0b5d7-e363-479a-8f48-b80f1f783c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:01.620322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 681/1369] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:01.670482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe2d2-9a87-415f-85cd-8091cfce9b65 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.670873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe2d2-9a87-415f-85cd-8091cfce9b65 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.671155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe2d2-9a87-415f-85cd-8091cfce9b65 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.673068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 689/1370] 10.222.0.30 () {54 vars in 961 bytes} [Wed Dec 15 16:14:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:01.679461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906047c8-d2d8-4bd6-8433-2a54cf387737 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.679754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906047c8-d2d8-4bd6-8433-2a54cf387737 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.680030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906047c8-d2d8-4bd6-8433-2a54cf387737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.702159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-906047c8-d2d8-4bd6-8433-2a54cf387737 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:01.708708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-906047c8-d2d8-4bd6-8433-2a54cf387737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:01.718402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 682/1371] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Dec 15 16:14:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:01.726956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fe2d2-9a87-415f-85cd-8091cfce9b65 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:01.742466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fe2d2-9a87-415f-85cd-8091cfce9b65 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:01.747984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:01.748711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.748987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.749252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.758976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:01.760668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a364d-ebe0-4846-875d-9a852cb553bb service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:01.772115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 690/1372] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:04.542299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820e85-8311-4cc8-a9f7-657955374b27 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.543233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820e85-8311-4cc8-a9f7-657955374b27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.543512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820e85-8311-4cc8-a9f7-657955374b27 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.545335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 683/1373] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:14:04.551898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0057f04-7daf-47f9-a789-5dcc714ef10a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.552902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0057f04-7daf-47f9-a789-5dcc714ef10a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.552902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0057f04-7daf-47f9-a789-5dcc714ef10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.571732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f0057f04-7daf-47f9-a789-5dcc714ef10a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:04.573301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f0057f04-7daf-47f9-a789-5dcc714ef10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:04.581997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 691/1374] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:04.616263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece7a1-b4f0-405f-ba81-f82186bc8b17 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.616798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece7a1-b4f0-405f-ba81-f82186bc8b17 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.617264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece7a1-b4f0-405f-ba81-f82186bc8b17 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.620753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 684/1375] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:04 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:04.631449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.631914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.632710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.638508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f87f2-cd1b-4303-88cc-324d68650057 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.638949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f87f2-cd1b-4303-88cc-324d68650057 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.639240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f87f2-cd1b-4303-88cc-324d68650057 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.641619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 685/1376] 10.222.0.30 () {54 vars in 963 bytes} [Wed Dec 15 16:14:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:14:04.647553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.648181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.648699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.663225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:04.665662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:04.679908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 692/1377] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:04.704339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] MFA Rules not processed for user `ab5f4ed434ad4685a93229ce1b6aef3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:04.705875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:04.762935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:04.778024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 686/1378] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Dec 15 16:14:04 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:04.779748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80c0b-7118-46ed-8fe4-5a42aa02b995 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:04.787168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:04.788402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:04.789334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.789699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.790057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.801469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de674-fb1f-42f4-98ba-29515f64c16e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:04.801823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:04.803081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fea40-bd1b-4d66-ae69-3c9bc7184297 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:04.807707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:04.808922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:04.809465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:04.810008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:04.813566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 693/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:04.821765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:04.823501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6826132-0a51-4fe0-a7c1-e756e8772977 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:04.835561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 687/1380] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:07.772980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed3d5-9417-4074-a18e-5d0abe03fc61 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:07.773517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed3d5-9417-4074-a18e-5d0abe03fc61 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:07.773517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed3d5-9417-4074-a18e-5d0abe03fc61 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:07.775335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 694/1381] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:07.782523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665efd-2ad4-43ae-8ada-77a37b7e565a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:07.783268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665efd-2ad4-43ae-8ada-77a37b7e565a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:07.783268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665efd-2ad4-43ae-8ada-77a37b7e565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:07.803189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-41665efd-2ad4-43ae-8ada-77a37b7e565a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:07.804527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-41665efd-2ad4-43ae-8ada-77a37b7e565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:07.815401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 688/1382] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:07.884009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fed3d5-9417-4074-a18e-5d0abe03fc61 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:07.902538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fed3d5-9417-4074-a18e-5d0abe03fc61 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:07.908337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:07.909237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:07.909685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:07.910108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:07.922122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:07.923758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22797-daf9-4cfd-92f9-45c4d559bc4f service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:07.941580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 695/1383] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:10.752812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af105fe-6ca8-41ed-8c6c-d249c7460d0e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:10.753559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af105fe-6ca8-41ed-8c6c-d249c7460d0e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:10.753707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af105fe-6ca8-41ed-8c6c-d249c7460d0e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:10.757419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 689/1384] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:10.767073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a99f-bee4-41af-84da-692caf0c0031 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:10.767599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a99f-bee4-41af-84da-692caf0c0031 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:10.767977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a99f-bee4-41af-84da-692caf0c0031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:10.796372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4043a99f-bee4-41af-84da-692caf0c0031 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:10.798273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4043a99f-bee4-41af-84da-692caf0c0031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:10.816639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 696/1385] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:10.897716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af105fe-6ca8-41ed-8c6c-d249c7460d0e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:10.922587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af105fe-6ca8-41ed-8c6c-d249c7460d0e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:10.940672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:10.941716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:10.942654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:10.942654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:10.958782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:10.961631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b3f9-47cb-4e7b-923b-3439efc17998 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:10.980235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 690/1386] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:13.647662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b09a4-e1a6-49ed-baa4-a5a92d02702a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:13.648210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b09a4-e1a6-49ed-baa4-a5a92d02702a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:13.648210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b09a4-e1a6-49ed-baa4-a5a92d02702a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:13.650059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 697/1387] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:13.656333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0f855-2f5f-41dc-8a39-f537e35bb14f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:13.656824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0f855-2f5f-41dc-8a39-f537e35bb14f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:13.656949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0f855-2f5f-41dc-8a39-f537e35bb14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:13.675556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-62e0f855-2f5f-41dc-8a39-f537e35bb14f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:13.677076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-62e0f855-2f5f-41dc-8a39-f537e35bb14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:13.685306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 691/1388] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:13.733831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b09a4-e1a6-49ed-baa4-a5a92d02702a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:13.754165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b09a4-e1a6-49ed-baa4-a5a92d02702a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:13.761026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:13.761664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:13.762029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:13.762222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:13.772497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:13.774221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158553dd-6b06-4b87-a592-136e1e8575df service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:13.788258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 698/1389] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:16.405542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7d2b-1518-4cf4-8d8d-0bceaf511719 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:16.406163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7d2b-1518-4cf4-8d8d-0bceaf511719 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:16.406451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7d2b-1518-4cf4-8d8d-0bceaf511719 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:16.410014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 692/1390] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:16 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:16.419288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8521a1-99f9-47b9-a424-9f98197a74c3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:16.419924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8521a1-99f9-47b9-a424-9f98197a74c3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:16.420195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8521a1-99f9-47b9-a424-9f98197a74c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:16.450576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fe8521a1-99f9-47b9-a424-9f98197a74c3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:16.451899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fe8521a1-99f9-47b9-a424-9f98197a74c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:16.466003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 699/1391] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:16.536666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d7d2b-1518-4cf4-8d8d-0bceaf511719 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:16.559218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d7d2b-1518-4cf4-8d8d-0bceaf511719 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:16.569229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:16.570354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:16.570817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:16.571327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:16.590077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:16.593217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe011-ff91-4119-8547-9ea0adb4494b service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:16.617125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 693/1392] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:19.376759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67bfc-2e8c-49c0-ac7c-47f133a805e5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:19.377314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67bfc-2e8c-49c0-ac7c-47f133a805e5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:19.377314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67bfc-2e8c-49c0-ac7c-47f133a805e5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:19.379789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 700/1393] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:19.388125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8ad-da9c-4634-b095-35bbf0ed98da None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:19.388756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8ad-da9c-4634-b095-35bbf0ed98da None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:19.388969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b8ad-da9c-4634-b095-35bbf0ed98da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:19.413202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3842b8ad-da9c-4634-b095-35bbf0ed98da None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:19.414789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3842b8ad-da9c-4634-b095-35bbf0ed98da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:19.423237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 694/1394] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:19.471798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67bfc-2e8c-49c0-ac7c-47f133a805e5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:19.487692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67bfc-2e8c-49c0-ac7c-47f133a805e5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:19.494233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:19.494907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:19.495196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:19.495474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:19.505740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:19.507427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994665e2-4800-4f4c-8342-ed271ccf8ba0 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:19.518738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 701/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:21.605587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793208e-3b32-40ff-8b31-4b16510574d4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:21.606197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793208e-3b32-40ff-8b31-4b16510574d4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:21.606197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793208e-3b32-40ff-8b31-4b16510574d4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:21.608185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 695/1396] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:21.614859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a90d0-8350-41f5-bed5-d43f97ccea3a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:21.615931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a90d0-8350-41f5-bed5-d43f97ccea3a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:21.615931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a90d0-8350-41f5-bed5-d43f97ccea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:21.635581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-406a90d0-8350-41f5-bed5-d43f97ccea3a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:21.636869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-406a90d0-8350-41f5-bed5-d43f97ccea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:21.645656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 702/1397] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 15 16:14:21.707425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892617-2b66-4be0-98a7-447758b0bebb None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:21.707425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892617-2b66-4be0-98a7-447758b0bebb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:21.707756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892617-2b66-4be0-98a7-447758b0bebb None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:21.709523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 696/1398] 10.222.0.30 () {54 vars in 962 bytes} [Wed Dec 15 16:14:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:21.716078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872288c-30c5-4b91-a0d0-d4d805efd315 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:21.716478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872288c-30c5-4b91-a0d0-d4d805efd315 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:21.716766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872288c-30c5-4b91-a0d0-d4d805efd315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:21.773781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c872288c-30c5-4b91-a0d0-d4d805efd315 None None] MFA Rules not processed for user `3403d8ed438642c0a1a7fddce5762087`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:21.775006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c872288c-30c5-4b91-a0d0-d4d805efd315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:21.842142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 703/1399] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Dec 15 16:14:21 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:21.851408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892617-2b66-4be0-98a7-447758b0bebb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:21.867863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892617-2b66-4be0-98a7-447758b0bebb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:21.874558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:21.875860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:21.876350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:21.876854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:21.892025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:21.894521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08449-8d65-4db7-b844-74b33e2acd04 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:21.910632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 697/1400] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:22.097772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46bcbb-298f-4fd0-abeb-8c2ec378e30a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.098037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46bcbb-298f-4fd0-abeb-8c2ec378e30a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.098331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46bcbb-298f-4fd0-abeb-8c2ec378e30a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.100094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 704/1401] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:22.106246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba272c-c24b-425d-9170-f887d12c9baf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.106588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba272c-c24b-425d-9170-f887d12c9baf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.106883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba272c-c24b-425d-9170-f887d12c9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.126336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-eaba272c-c24b-425d-9170-f887d12c9baf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:22.127588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-eaba272c-c24b-425d-9170-f887d12c9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:22.145593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 698/1402] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:22.192666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46bcbb-298f-4fd0-abeb-8c2ec378e30a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:22.210068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46bcbb-298f-4fd0-abeb-8c2ec378e30a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:22.217126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:22.217808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.218083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.218351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.228975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:22.230667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e74dc-f02d-4658-9c0c-cf1b77191bd7 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:22.242543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 705/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:22.404096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0d37-0f86-4a5e-bdf6-c97a727ba92a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.404366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0d37-0f86-4a5e-bdf6-c97a727ba92a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.404696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0d37-0f86-4a5e-bdf6-c97a727ba92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.464247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c50b0d37-0f86-4a5e-bdf6-c97a727ba92a None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:22.465573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c50b0d37-0f86-4a5e-bdf6-c97a727ba92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:22.552539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 699/1404] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:14:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:22.602335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c4ec-5f95-4536-a775-91eadc793bf5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.602635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c4ec-5f95-4536-a775-91eadc793bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.602952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c4ec-5f95-4536-a775-91eadc793bf5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.605589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 706/1405] 10.222.0.30 () {54 vars in 942 bytes} [Wed Dec 15 16:14:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:22.613665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded8ca-f5d6-4c5b-8730-5df8a3af394c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.614166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded8ca-f5d6-4c5b-8730-5df8a3af394c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.614402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded8ca-f5d6-4c5b-8730-5df8a3af394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.679129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7bded8ca-f5d6-4c5b-8730-5df8a3af394c None None] MFA Rules not processed for user `a8dc448d7e48411eac14da58bb0fde06`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:22.680290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7bded8ca-f5d6-4c5b-8730-5df8a3af394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:22.765245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 700/1406] 10.222.0.30 () {58 vars in 1039 bytes} [Wed Dec 15 16:14:22 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:22.775977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668c4ec-5f95-4536-a775-91eadc793bf5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:22.796181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668c4ec-5f95-4536-a775-91eadc793bf5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:22.804922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:22.805907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:22.806368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:22.806745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:22.819902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:22.821593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794374-1805-473c-80c1-10a10056b5b8 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:22.830347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 707/1407] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:14:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:24.926045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cfe0-a563-4c62-8628-a47d7a9000a3 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.926678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cfe0-a563-4c62-8628-a47d7a9000a3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.926678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cfe0-a563-4c62-8628-a47d7a9000a3 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.928475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 701/1408] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:24.934930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f5f3-16c8-43d7-b740-87b6c13b1775 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.935482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f5f3-16c8-43d7-b740-87b6c13b1775 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.935482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f5f3-16c8-43d7-b740-87b6c13b1775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.954185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2606f5f3-16c8-43d7-b740-87b6c13b1775 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:24.955770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2606f5f3-16c8-43d7-b740-87b6c13b1775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:24.965232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 708/1409] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:25.045295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84cfe0-a563-4c62-8628-a47d7a9000a3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:25.062693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84cfe0-a563-4c62-8628-a47d7a9000a3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:25.069770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:25.070587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.070937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.071276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.081031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:25.082754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81d41a-a119-46ac-922f-3aab78ecc54f service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:25.093281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 702/1410] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:27.701211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148cdce-5aaf-4214-b89a-eb4b2aadfabe None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.701784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148cdce-5aaf-4214-b89a-eb4b2aadfabe None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.701784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148cdce-5aaf-4214-b89a-eb4b2aadfabe None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.703942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 709/1411] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:14:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:27.711196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03a2-e56d-40cf-af06-1e761958caa3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.711796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03a2-e56d-40cf-af06-1e761958caa3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.711796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03a2-e56d-40cf-af06-1e761958caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.735598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c58c03a2-e56d-40cf-af06-1e761958caa3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:27.735598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c58c03a2-e56d-40cf-af06-1e761958caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:27.742158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 703/1412] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:27.794409 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148cdce-5aaf-4214-b89a-eb4b2aadfabe None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.812136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148cdce-5aaf-4214-b89a-eb4b2aadfabe None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.819878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.820558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.820970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.821244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.830595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.832644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f11c1-464f-4108-9822-772ffafb6406 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.850812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 710/1413] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:46.152291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373d98-0ba0-481f-bda0-41d83843fc50 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.152948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373d98-0ba0-481f-bda0-41d83843fc50 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.152948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373d98-0ba0-481f-bda0-41d83843fc50 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.154692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 704/1414] 10.222.0.30 () {54 vars in 918 bytes} [Wed Dec 15 16:14:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:46.161904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b0b2-1679-4bd5-9017-11553d960a44 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.162405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b0b2-1679-4bd5-9017-11553d960a44 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.162405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b0b2-1679-4bd5-9017-11553d960a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.182484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ae5b0b2-1679-4bd5-9017-11553d960a44 None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:46.183678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ae5b0b2-1679-4bd5-9017-11553d960a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.194067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 711/1415] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:46.210029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8a42-80d7-4b44-bb33-dadc43aad025 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.210317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8a42-80d7-4b44-bb33-dadc43aad025 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.210574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8a42-80d7-4b44-bb33-dadc43aad025 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.212365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 705/1416] 10.222.0.30 () {54 vars in 918 bytes} [Wed Dec 15 16:14:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:46.217837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6b9e-fd35-4743-bfac-17d97cf018fa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.218121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6b9e-fd35-4743-bfac-17d97cf018fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.218396 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6b9e-fd35-4743-bfac-17d97cf018fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.237905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9d2d6b9e-fd35-4743-bfac-17d97cf018fa None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:46.239092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d2d6b9e-fd35-4743-bfac-17d97cf018fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.249664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 712/1417] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:49.097032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f158e17-095c-4ba0-b651-26a40542eb96 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.097668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f158e17-095c-4ba0-b651-26a40542eb96 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.097668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f158e17-095c-4ba0-b651-26a40542eb96 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.099360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 706/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:14:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:49.106216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545f917-48c1-4af4-9247-0658847515f0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.106751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545f917-48c1-4af4-9247-0658847515f0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.106751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545f917-48c1-4af4-9247-0658847515f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.127179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1545f917-48c1-4af4-9247-0658847515f0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:49.128416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1545f917-48c1-4af4-9247-0658847515f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.136991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 713/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:14:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:49.191872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f158e17-095c-4ba0-b651-26a40542eb96 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:49.213576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f158e17-095c-4ba0-b651-26a40542eb96 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.220352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.221058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.221349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.221611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.231702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.233377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0af61-eab4-4a95-ad25-cfa12b2ec1f4 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.244182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 707/1420] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:50.852911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36703-53ab-4da4-8875-e98f20990c9a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:50.853492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36703-53ab-4da4-8875-e98f20990c9a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:50.853492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36703-53ab-4da4-8875-e98f20990c9a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:50.855421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 714/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:50.861229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81b7d3-81d3-4cb2-9cd9-61c916060c6c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:50.861746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81b7d3-81d3-4cb2-9cd9-61c916060c6c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:50.861746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81b7d3-81d3-4cb2-9cd9-61c916060c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:50.880424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fa81b7d3-81d3-4cb2-9cd9-61c916060c6c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:50.881652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa81b7d3-81d3-4cb2-9cd9-61c916060c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:50.889950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 708/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:51.041847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36703-53ab-4da4-8875-e98f20990c9a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.058580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36703-53ab-4da4-8875-e98f20990c9a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.064598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.065237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.065512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.065764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.074724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.076303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc60e-9f1f-4ab8-bf22-d7ef5d86e680 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.086103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 715/1423] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:52.667207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33633bc-3406-4430-968a-f61a576f83e9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:52.667831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33633bc-3406-4430-968a-f61a576f83e9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:52.667831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33633bc-3406-4430-968a-f61a576f83e9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:52.669685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 709/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:52.675757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4ce3-f6ff-4ad8-8962-be58a5ecfde4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:52.676230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4ce3-f6ff-4ad8-8962-be58a5ecfde4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:52.676348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4ce3-f6ff-4ad8-8962-be58a5ecfde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:52.697968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0c4e4ce3-f6ff-4ad8-8962-be58a5ecfde4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:52.699176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0c4e4ce3-f6ff-4ad8-8962-be58a5ecfde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:52.707160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 716/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:52.865963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33633bc-3406-4430-968a-f61a576f83e9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:52.881793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33633bc-3406-4430-968a-f61a576f83e9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:52.887976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:52.888669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:52.888950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:52.889238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:52.899355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:52.901271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb4833-d062-4717-b440-a62133a81f27 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:52.911929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 710/1426] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:54.488936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cc48-cc6e-4e46-b36c-0ae0884ef3a5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:54.489524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cc48-cc6e-4e46-b36c-0ae0884ef3a5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:54.489524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cc48-cc6e-4e46-b36c-0ae0884ef3a5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:54.491537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 717/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:54.497758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9961-1f93-45d3-885f-d1d9fc537b27 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:54.498242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9961-1f93-45d3-885f-d1d9fc537b27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:54.498340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9961-1f93-45d3-885f-d1d9fc537b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:54.516650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ae7e9961-1f93-45d3-885f-d1d9fc537b27 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:54.518047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ae7e9961-1f93-45d3-885f-d1d9fc537b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:54.527223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 711/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:54.679672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9cc48-cc6e-4e46-b36c-0ae0884ef3a5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:54.694413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9cc48-cc6e-4e46-b36c-0ae0884ef3a5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:54.700395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:54.701081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:54.701358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:54.701673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:54.710191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:54.712055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d65d6a-6104-4a52-9368-1a9dbe574751 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:54.722465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 718/1429] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:56.309924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afe41-096b-48f2-9485-a488f3d32e24 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:56.310591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afe41-096b-48f2-9485-a488f3d32e24 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:56.310591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afe41-096b-48f2-9485-a488f3d32e24 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:56.312298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 712/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:56.319096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f100fb-a907-4a73-814b-442e4bbde501 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:56.319711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f100fb-a907-4a73-814b-442e4bbde501 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:56.319711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f100fb-a907-4a73-814b-442e4bbde501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:56.340105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-08f100fb-a907-4a73-814b-442e4bbde501 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:56.341363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-08f100fb-a907-4a73-814b-442e4bbde501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:56.350512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 719/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:56.508177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afe41-096b-48f2-9485-a488f3d32e24 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:56.524743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afe41-096b-48f2-9485-a488f3d32e24 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:56.531298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:56.531954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:56.532302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:56.532604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:56.541544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:56.543174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da481-0112-4eca-ab93-4ece9106dd99 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:56.553409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 713/1432] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:58.072713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88568-67b0-412c-9915-3891589c3b8c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:58.073325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88568-67b0-412c-9915-3891589c3b8c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:58.073325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88568-67b0-412c-9915-3891589c3b8c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:58.075077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 720/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:58.081634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b6be0-bc24-4752-9a4b-ce6d57b99b0c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:58.082141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b6be0-bc24-4752-9a4b-ce6d57b99b0c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:58.082141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b6be0-bc24-4752-9a4b-ce6d57b99b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:58.102412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-601b6be0-bc24-4752-9a4b-ce6d57b99b0c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:58.104275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-601b6be0-bc24-4752-9a4b-ce6d57b99b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:58.112921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 714/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:58.270924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88568-67b0-412c-9915-3891589c3b8c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:58.287595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88568-67b0-412c-9915-3891589c3b8c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:58.293334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:58.293990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:58.294272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:58.294546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:58.303795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:58.305433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09f3c-b992-493f-a6c1-03bc6f28a709 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:58.314983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 721/1435] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:59.818183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be2feb-7896-4e7e-b28b-8e4905ce78b0 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:59.818803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be2feb-7896-4e7e-b28b-8e4905ce78b0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:59.818803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be2feb-7896-4e7e-b28b-8e4905ce78b0 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:59.820607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 715/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:14:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:14:59.826809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669852b-eaa8-485c-b89e-2648d0c808f3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:59.827317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669852b-eaa8-485c-b89e-2648d0c808f3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:59.827317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669852b-eaa8-485c-b89e-2648d0c808f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:59.847662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f669852b-eaa8-485c-b89e-2648d0c808f3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:59.848979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f669852b-eaa8-485c-b89e-2648d0c808f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:59.858304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 722/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:14:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:00.014940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be2feb-7896-4e7e-b28b-8e4905ce78b0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:00.030577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be2feb-7896-4e7e-b28b-8e4905ce78b0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:00.037059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:00.037734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:00.038012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:00.038296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:00.047934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:00.049813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34446-f63e-4404-9c5c-67a4bd61e8b3 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:00.060560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 716/1438] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:01.540783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846c25-68a2-4e51-a5c0-c3a34d068e32 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:01.541338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846c25-68a2-4e51-a5c0-c3a34d068e32 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:01.541338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846c25-68a2-4e51-a5c0-c3a34d068e32 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:01.542974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 723/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:15:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:01.549029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95066-595c-42ee-bf8a-fa0d80a0d025 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:01.549488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95066-595c-42ee-bf8a-fa0d80a0d025 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:01.549601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95066-595c-42ee-bf8a-fa0d80a0d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:01.568611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4ec95066-595c-42ee-bf8a-fa0d80a0d025 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:01.569853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4ec95066-595c-42ee-bf8a-fa0d80a0d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:01.578223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 717/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:15:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:01.731540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b846c25-68a2-4e51-a5c0-c3a34d068e32 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:01.754512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b846c25-68a2-4e51-a5c0-c3a34d068e32 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:01.763509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:01.764197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:01.764621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:01.764908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:01.775551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:01.777190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dbe8e-33cb-4a41-b4a5-6277fb7b3c85 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:01.787999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 724/1441] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:03.333346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa697-a7b2-4649-af9d-86bdade972b5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:03.333988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa697-a7b2-4649-af9d-86bdade972b5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:03.333988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa697-a7b2-4649-af9d-86bdade972b5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:03.335655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 718/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:15:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:03.341739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800dff-2f64-493f-91d7-816452d20420 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:03.342209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800dff-2f64-493f-91d7-816452d20420 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:03.342316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800dff-2f64-493f-91d7-816452d20420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:03.362480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-30800dff-2f64-493f-91d7-816452d20420 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:03.363687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-30800dff-2f64-493f-91d7-816452d20420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:03.372839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 725/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:15:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:03.539870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa697-a7b2-4649-af9d-86bdade972b5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:03.560704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa697-a7b2-4649-af9d-86bdade972b5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:03.567372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:03.568062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:03.568350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:03.568669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:03.578021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:03.579899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9f3bc-cf7c-4bff-b2a4-8a1e2b86a8e6 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:03.590664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 719/1444] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:05.860579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76ff53-c69a-45aa-942a-eecc58ec7bd0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.861223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76ff53-c69a-45aa-942a-eecc58ec7bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.861223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76ff53-c69a-45aa-942a-eecc58ec7bd0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.862938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 726/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:05.875354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6705e-5d7a-4722-94f9-f348e380d24b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.875992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6705e-5d7a-4722-94f9-f348e380d24b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.876110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6705e-5d7a-4722-94f9-f348e380d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.896365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-09b6705e-5d7a-4722-94f9-f348e380d24b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:05.897633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-09b6705e-5d7a-4722-94f9-f348e380d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:05.906281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 720/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:05.948466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76ff53-c69a-45aa-942a-eecc58ec7bd0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.961086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76ff53-c69a-45aa-942a-eecc58ec7bd0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.965316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.965966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.966251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.966552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.977157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.978629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601318-b62d-4686-8cd0-fb73d6c97d51 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.988591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 727/1447] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:08.579043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebfcb-af60-4d48-82f6-16f9f14651ee None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:08.579043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebfcb-af60-4d48-82f6-16f9f14651ee None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:08.580832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebfcb-af60-4d48-82f6-16f9f14651ee None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:08.581519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 721/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:08.587670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b75d-334c-45ad-95ba-5be9c648f39e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:08.588127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b75d-334c-45ad-95ba-5be9c648f39e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:08.588235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b75d-334c-45ad-95ba-5be9c648f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:08.606633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c301b75d-334c-45ad-95ba-5be9c648f39e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:08.607815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c301b75d-334c-45ad-95ba-5be9c648f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:08.615658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 728/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:08.656359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ebfcb-af60-4d48-82f6-16f9f14651ee None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:08.668968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ebfcb-af60-4d48-82f6-16f9f14651ee None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:08.673427 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:08.674076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:08.674357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:08.674629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:08.683961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:08.685403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4434d1d-40d0-4c43-8acd-8fb98ff711bb service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:08.694965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 722/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:11.377402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611d4d-7438-4eed-abcd-ab18dc940c52 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.378026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611d4d-7438-4eed-abcd-ab18dc940c52 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.378026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611d4d-7438-4eed-abcd-ab18dc940c52 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.379620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 729/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:11.386087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123165-3ccc-4b66-acd6-c12d4f126889 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.386585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123165-3ccc-4b66-acd6-c12d4f126889 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.386689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123165-3ccc-4b66-acd6-c12d4f126889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.405432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fe123165-3ccc-4b66-acd6-c12d4f126889 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:11.406706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fe123165-3ccc-4b66-acd6-c12d4f126889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:11.414954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 723/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:11.455156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611d4d-7438-4eed-abcd-ab18dc940c52 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:11.467091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611d4d-7438-4eed-abcd-ab18dc940c52 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:11.471618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:11.472282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.472604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.472882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.487435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:11.488994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4550d-5f4b-4050-a0cb-d5240a22c2c4 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:11.500287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 730/1453] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:14.018937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efcff3-2bc7-492c-a50e-718c91538bca None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:14.019500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efcff3-2bc7-492c-a50e-718c91538bca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:14.019500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efcff3-2bc7-492c-a50e-718c91538bca None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:14.021199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 724/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:14.027697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977888-181d-4a35-9494-030e67649adc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:14.028151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977888-181d-4a35-9494-030e67649adc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:14.028244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977888-181d-4a35-9494-030e67649adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:14.049205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-24977888-181d-4a35-9494-030e67649adc None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:14.050394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-24977888-181d-4a35-9494-030e67649adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:14.059463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 731/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:14.099766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efcff3-2bc7-492c-a50e-718c91538bca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:14.112862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efcff3-2bc7-492c-a50e-718c91538bca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:14.118120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:14.118884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:14.119288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:14.119852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:14.131100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:14.132636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af0fb7-d587-4fa9-a455-af680968f454 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:14.142735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 725/1456] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:16.728066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853b60-2a5e-4cbd-9d53-1e55621de912 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:16.728873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853b60-2a5e-4cbd-9d53-1e55621de912 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:16.728873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853b60-2a5e-4cbd-9d53-1e55621de912 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:16.730570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:16.737600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909e9d-2138-4492-8997-f12f29aee3ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:16.738165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909e9d-2138-4492-8997-f12f29aee3ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:16.738165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909e9d-2138-4492-8997-f12f29aee3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:16.762625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-91909e9d-2138-4492-8997-f12f29aee3ea None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:16.764144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-91909e9d-2138-4492-8997-f12f29aee3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:16.775853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:16.819649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853b60-2a5e-4cbd-9d53-1e55621de912 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:16.831031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853b60-2a5e-4cbd-9d53-1e55621de912 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:16.835047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:16.835689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:16.835970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:16.836247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:16.846120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:16.847554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e8c4f-acee-4ba4-b1f2-29c84cfa9f88 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:16.867455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 733/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:19.368049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2de0-d252-4b8c-a6f5-839457e90b84 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:19.368730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2de0-d252-4b8c-a6f5-839457e90b84 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:19.368730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2de0-d252-4b8c-a6f5-839457e90b84 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:19.370403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 727/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:19.377074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836407-9d47-4e0b-9ac3-a49affe9c7d5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:19.377554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836407-9d47-4e0b-9ac3-a49affe9c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:19.377554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836407-9d47-4e0b-9ac3-a49affe9c7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:19.396868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-64836407-9d47-4e0b-9ac3-a49affe9c7d5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:19.398059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-64836407-9d47-4e0b-9ac3-a49affe9c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:19.408142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 734/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:19.447598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2de0-d252-4b8c-a6f5-839457e90b84 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:19.460209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2de0-d252-4b8c-a6f5-839457e90b84 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:19.464310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:19.465006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:19.465295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:19.465574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:19.476272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:19.477775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa58d-a723-43b7-9bc9-4d346da6123f service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:19.488514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 728/1462] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:21.951845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9371-01ff-443f-981a-a0f84617b887 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:21.952494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9371-01ff-443f-981a-a0f84617b887 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:21.952719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9371-01ff-443f-981a-a0f84617b887 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:21.954564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:21.960955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17172-1e3d-44f8-bc7b-9b77cad4613d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:21.961474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17172-1e3d-44f8-bc7b-9b77cad4613d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:21.961631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17172-1e3d-44f8-bc7b-9b77cad4613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:21.980661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-45e17172-1e3d-44f8-bc7b-9b77cad4613d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:21.981862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-45e17172-1e3d-44f8-bc7b-9b77cad4613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:21.991677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:15:22.031805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd9371-01ff-443f-981a-a0f84617b887 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:22.043476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd9371-01ff-443f-981a-a0f84617b887 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:22.047357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:22.047990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:22.048274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:22.048582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:22.058399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:22.059673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac046c0-7821-4f8a-aef9-0b9c4a23d1e2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:22.070226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 736/1465] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:24.568802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df054699-960c-40f1-85d2-6bde90aa348f None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:24.569364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df054699-960c-40f1-85d2-6bde90aa348f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:24.569364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df054699-960c-40f1-85d2-6bde90aa348f None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:24.572286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:24.580326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f2723-87ee-4a9d-90dc-3d8cf8de35b9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:24.580848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f2723-87ee-4a9d-90dc-3d8cf8de35b9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:24.580955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f2723-87ee-4a9d-90dc-3d8cf8de35b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:24.599371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-641f2723-87ee-4a9d-90dc-3d8cf8de35b9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:24.600911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-641f2723-87ee-4a9d-90dc-3d8cf8de35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:24.608964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:24.647973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df054699-960c-40f1-85d2-6bde90aa348f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:24.659806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df054699-960c-40f1-85d2-6bde90aa348f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:24.663658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:24.664290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:24.664610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:24.664885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:24.674612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:24.676051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898f711-fbd2-4345-9797-354dd81e09e4 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:24.685855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 731/1468] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:27.143698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58091-b02a-4c35-8e95-aea773f572be None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.144346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58091-b02a-4c35-8e95-aea773f572be None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.144346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58091-b02a-4c35-8e95-aea773f572be None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.146220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 738/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:27.152625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750bb0b-7392-4cb2-9012-215251009dbf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.153094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750bb0b-7392-4cb2-9012-215251009dbf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.153214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750bb0b-7392-4cb2-9012-215251009dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.172617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4750bb0b-7392-4cb2-9012-215251009dbf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:27.173814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4750bb0b-7392-4cb2-9012-215251009dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:27.183151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 732/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:27.221448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd58091-b02a-4c35-8e95-aea773f572be None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.232687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd58091-b02a-4c35-8e95-aea773f572be None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.236737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.237821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.238306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.238779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.249732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.251179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a59b0-f4f4-4624-9da8-036c1aaf6dc9 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.261421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 739/1471] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:29.702149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62c6c-819e-448c-8675-779f3f37c379 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:29.702780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62c6c-819e-448c-8675-779f3f37c379 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:29.702924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62c6c-819e-448c-8675-779f3f37c379 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:29.704886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 733/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:15:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:29.711352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dcf1-3d8e-4f28-a327-52deb8328ab5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:29.711826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dcf1-3d8e-4f28-a327-52deb8328ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:29.711941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dcf1-3d8e-4f28-a327-52deb8328ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:29.731507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d532dcf1-3d8e-4f28-a327-52deb8328ab5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:29.732763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d532dcf1-3d8e-4f28-a327-52deb8328ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:29.741240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 740/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:29.782324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62c6c-819e-448c-8675-779f3f37c379 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:29.793889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62c6c-819e-448c-8675-779f3f37c379 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:29.797834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:29.798481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:29.798769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:29.799042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:29.808801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:29.810256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db59d5-dff7-4e53-aee2-29bbac93606d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:29.820537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 734/1474] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:47.159570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7633b2-455b-49ad-a835-177e3224e19f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:47.160188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7633b2-455b-49ad-a835-177e3224e19f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:47.160188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7633b2-455b-49ad-a835-177e3224e19f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:47.161926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 741/1475] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:15:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:47.167992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd7a1-7bb1-482c-a598-7291d2df8234 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:47.168486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd7a1-7bb1-482c-a598-7291d2df8234 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:47.168621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd7a1-7bb1-482c-a598-7291d2df8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:47.188376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-729fd7a1-7bb1-482c-a598-7291d2df8234 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:47.189822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-729fd7a1-7bb1-482c-a598-7291d2df8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:47.199042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 735/1476] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:47.249766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b481e-b9c5-4bfc-bdd4-7065bb19b6a5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:47.250052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b481e-b9c5-4bfc-bdd4-7065bb19b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:47.250327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b481e-b9c5-4bfc-bdd4-7065bb19b6a5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:47.252210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 742/1477] 10.222.0.30 () {54 vars in 962 bytes} [Wed Dec 15 16:15:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:47.258027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47a72-f22a-430b-b65f-a25353e68a60 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:47.258310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47a72-f22a-430b-b65f-a25353e68a60 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:47.258583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47a72-f22a-430b-b65f-a25353e68a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:47.278244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-61d47a72-f22a-430b-b65f-a25353e68a60 None None] MFA Rules not processed for user `3403d8ed438642c0a1a7fddce5762087`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:47.279750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-61d47a72-f22a-430b-b65f-a25353e68a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:47.287869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 736/1478] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Dec 15 16:15:47 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:47.295828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b481e-b9c5-4bfc-bdd4-7065bb19b6a5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:47.307196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b481e-b9c5-4bfc-bdd4-7065bb19b6a5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:47.311350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:47.311990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:47.312256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:47.312574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:47.322431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:47.323888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78278cf8-46f9-498c-96b2-9239bd325061 service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:47.333719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 743/1479] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:49.826366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16816-f39e-4a72-9ff7-35bce4f1e80c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:49.827062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16816-f39e-4a72-9ff7-35bce4f1e80c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:49.827062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16816-f39e-4a72-9ff7-35bce4f1e80c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:49.828789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 737/1480] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:15:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:49.835086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94a0-ee36-4241-90de-8d812973f2fa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:49.835555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94a0-ee36-4241-90de-8d812973f2fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:49.835677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94a0-ee36-4241-90de-8d812973f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:49.859779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ffa94a0-ee36-4241-90de-8d812973f2fa None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:49.861020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ffa94a0-ee36-4241-90de-8d812973f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:49.869752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 744/1481] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:15:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:49.894923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e16816-f39e-4a72-9ff7-35bce4f1e80c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:49.911836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e16816-f39e-4a72-9ff7-35bce4f1e80c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:49.918918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:49.920107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:49.920384 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:49.920693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:49.921445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:49.923336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4132d-b85e-4c01-92d2-bc13d87baf1b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:49.938391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 738/1482] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Dec 15 16:15:49 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:52.367829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815dee-ce69-4386-aafa-c4441002d967 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:52.368425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815dee-ce69-4386-aafa-c4441002d967 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:52.368425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815dee-ce69-4386-aafa-c4441002d967 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:52.370207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 745/1483] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:15:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:52.376652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49d21-8a6e-4bf1-9b3f-73161efd968b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:52.377121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49d21-8a6e-4bf1-9b3f-73161efd968b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:52.377121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49d21-8a6e-4bf1-9b3f-73161efd968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:52.396612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8fc49d21-8a6e-4bf1-9b3f-73161efd968b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:52.397823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8fc49d21-8a6e-4bf1-9b3f-73161efd968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:52.407317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 739/1484] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:15:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:52.451589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815dee-ce69-4386-aafa-c4441002d967 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:52.467056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815dee-ce69-4386-aafa-c4441002d967 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:52.473042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:52.473678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:52.473958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:52.474224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:52.483733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:52.485383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2027-8356-409f-9a82-af8f2f1dfc7c service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:52.495400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 746/1485] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:55.094493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0fe8b-c55e-4787-8209-ed8a33d6d4d5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:55.095429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0fe8b-c55e-4787-8209-ed8a33d6d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:55.095711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0fe8b-c55e-4787-8209-ed8a33d6d4d5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:55.097674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 740/1486] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:15:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:55.104814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb252df5-7565-4ea2-9fdd-236b9ac95a73 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:55.105350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb252df5-7565-4ea2-9fdd-236b9ac95a73 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:55.105350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb252df5-7565-4ea2-9fdd-236b9ac95a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:55.125648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bb252df5-7565-4ea2-9fdd-236b9ac95a73 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:55.126925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb252df5-7565-4ea2-9fdd-236b9ac95a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:55.136045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 747/1487] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:15:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:55.174452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0fe8b-c55e-4787-8209-ed8a33d6d4d5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:55.186576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0fe8b-c55e-4787-8209-ed8a33d6d4d5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:55.190782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:55.191434 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:55.191709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:55.191981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:55.202112 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:55.203571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4ec4-9608-443b-b07f-bbdfe04f617c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:55.213428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 741/1488] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:57.641733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c707-b0fb-481b-a385-ce0650da81c5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:57.642375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c707-b0fb-481b-a385-ce0650da81c5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:57.642375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7c707-b0fb-481b-a385-ce0650da81c5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:57.644121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 748/1489] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:15:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:15:57.651867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f13e-1689-45a0-9336-594e8da007cf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:57.652396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f13e-1689-45a0-9336-594e8da007cf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:57.652396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f13e-1689-45a0-9336-594e8da007cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:57.670495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3280f13e-1689-45a0-9336-594e8da007cf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:57.671700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3280f13e-1689-45a0-9336-594e8da007cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:57.679788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 742/1490] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:15:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:57.720460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7c707-b0fb-481b-a385-ce0650da81c5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:57.732590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7c707-b0fb-481b-a385-ce0650da81c5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:57.736583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:57.737263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:57.737518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:57.737792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:57.748465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:57.750019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feb3de-7f29-4268-ac01-0f12b9b630fa service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:57.760137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 749/1491] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:00.257233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae729fb-4b98-47ee-a717-a10034345832 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:00.257847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae729fb-4b98-47ee-a717-a10034345832 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:00.257847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae729fb-4b98-47ee-a717-a10034345832 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:00.259624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 743/1492] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:16:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:16:00.266349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d171a-79d4-4381-864d-8160a2a8cb26 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:00.267072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d171a-79d4-4381-864d-8160a2a8cb26 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:00.267294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d171a-79d4-4381-864d-8160a2a8cb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:00.287381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-126d171a-79d4-4381-864d-8160a2a8cb26 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:00.288625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-126d171a-79d4-4381-864d-8160a2a8cb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:00.297743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 750/1493] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:16:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:00.339917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae729fb-4b98-47ee-a717-a10034345832 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:00.351971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae729fb-4b98-47ee-a717-a10034345832 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:00.355745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:00.356393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:00.356718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:00.357069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:00.367059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:00.368539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049078a-70f0-45a6-a245-fcbca06dce91 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:00.378262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 744/1494] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:03.002939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185000-80be-444e-999e-264b4c7274a7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:03.003530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185000-80be-444e-999e-264b4c7274a7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:03.005147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185000-80be-444e-999e-264b4c7274a7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:03.007015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 751/1495] 10.222.0.30 () {54 vars in 926 bytes} [Wed Dec 15 16:16:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:16:03.013589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937451-fab6-4179-8e9c-3c3859139e1f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:03.014131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937451-fab6-4179-8e9c-3c3859139e1f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:03.014131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937451-fab6-4179-8e9c-3c3859139e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:03.033325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2d937451-fab6-4179-8e9c-3c3859139e1f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:03.034560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2d937451-fab6-4179-8e9c-3c3859139e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:03.044019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 745/1496] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Dec 15 16:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:03.085341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185000-80be-444e-999e-264b4c7274a7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:03.098408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185000-80be-444e-999e-264b4c7274a7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:03.103342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:03.103998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:03.104279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:03.104597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:03.114367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:03.115817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92359d-6967-4014-beb8-bf6c4e5cb4f3 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:03.125827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 752/1497] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:17.658510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.659147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.659147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.678079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:17.679282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:17.689308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 746/1498] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:17:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:17.698327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.699673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.699673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.718414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:17.719624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:17.729496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 753/1499] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:17:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:17.734860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:17.745359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50999b-428d-443d-9945-c8dd2d6c41a0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:17.751293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:17.751984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.752263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.752551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.753312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:17:17.753663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:17.755258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:17.767467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 747/1500] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:17:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:17:17.775949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:17.785692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e2b7-261f-4d68-8aa7-ccdd1f43dda8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:17.791170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:17.792015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.792342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.792645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.793360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:17.795264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:17.833489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 754/1501] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:17:17 2021] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:17:17.837934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:17.849851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93da7aa-2ef6-47db-8ea5-dbaa85bfa330 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:17.906951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:17.907636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.907911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.908167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.909003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:17.910886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:17.932392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 748/1502] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:17:17 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:17:17.937099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:17.948224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eeb50-1f84-498e-8dc9-52dd953283e2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:17.953739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:17.954429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.954712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.954984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.955725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:17.957418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:17.971993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 755/1503] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:17.976986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:17.987321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515fa8-b759-452e-b113-34c4f4134208 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:17.993865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:17.994626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:17.995039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:17.995512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:17.996338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:17.998208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9905f-c228-4237-abbe-b4a3ea2c4c99 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:18.013508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 749/1504] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:17 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:18.018069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:18.028889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd897-4cc4-4740-b791-d895930cfac1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:18.034914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:18.035816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.036098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.036364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] PATH_INFO: `/v3/projects/a313baebe9ca4d859e1ff2e79fbbe4f4/users/07b8b08c10424f50845b7bcae03b1c9f/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.053096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a313baebe9ca4d859e1ff2e79fbbe4f4, user_id=07b8b08c10424f50845b7bcae03b1c9f, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:18.055771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:18.070278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 756/1505] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:17:18 2021] PUT /identity/v3/projects/a313baebe9ca4d859e1ff2e79fbbe4f4/users/07b8b08c10424f50845b7bcae03b1c9f/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:18.082064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f5df-c10a-47b7-b5a5-c03f907b7688 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.082384 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f5df-c10a-47b7-b5a5-c03f907b7688 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.082683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f5df-c10a-47b7-b5a5-c03f907b7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.112268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5013f5df-c10a-47b7-b5a5-c03f907b7688 None None] MFA Rules not processed for user `07b8b08c10424f50845b7bcae03b1c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:18.113550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5013f5df-c10a-47b7-b5a5-c03f907b7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:18.181625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 750/1506] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:17:18 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:18.194696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:18.266798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4796727-15df-407c-acb7-c805d67b3813 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:18.273367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:18.274017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.274294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.274561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.283095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:18.284737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:18.294930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 757/1507] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:18 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:18.364846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162443-6ac6-4aba-a659-1aba154f1d07 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.365135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162443-6ac6-4aba-a659-1aba154f1d07 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.365412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162443-6ac6-4aba-a659-1aba154f1d07 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.367163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 751/1508] 10.222.0.30 () {52 vars in 829 bytes} [Wed Dec 15 16:17:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:17:18.371653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:18.439794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c704-0cb5-4e60-b760-523fca736def service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:18.444781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:18.445660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.445955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.446226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] PATH_INFO: `/v3/users/07b8b08c10424f50845b7bcae03b1c9f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.447507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b8b08c10424f50845b7bcae03b1c9f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:18.449164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:18.449164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:17:18.449164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:17:18.450356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:18.517217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b8b08c10424f50845b7bcae03b1c9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:18.517989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b8b08c10424f50845b7bcae03b1c9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:18.529694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b8b08c10424f50845b7bcae03b1c9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:18.550956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b8b08c10424f50845b7bcae03b1c9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:18.562639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b8b08c10424f50845b7bcae03b1c9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:18.570484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 758/1509] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:17:18 2021] DELETE /identity/v3/users/07b8b08c10424f50845b7bcae03b1c9f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:18.577363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.577641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.577907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.596055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:18.597270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:18.661187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 752/1510] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:17:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:18.672505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:18.674163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:18.733062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df0e-517e-4b39-93d8-c7293701034f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:18.736658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:18.737319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:18.737604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:18.737869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:18.747699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:18.749194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b3469-4554-4283-8de7-6cc2b9df4ef0 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:18.758653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 759/1511] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:19.095930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:19.097546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:19.110460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c316745-0f14-492f-81c6-764bca385bb0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:19.116045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] PATH_INFO: `/v3/projects/a313baebe9ca4d859e1ff2e79fbbe4f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a313baebe9ca4d859e1ff2e79fbbe4f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:17:19.120520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:17:19.121227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:19.185781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a313baebe9ca4d859e1ff2e79fbbe4f4', 'request_id': 'req-68dfa822-33a3-40c8-a0c6-1a0518afe153'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:19.191666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a313baebe9ca4d859e1ff2e79fbbe4f4', 'request_id': 'req-68dfa822-33a3-40c8-a0c6-1a0518afe153'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:19.205308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a313baebe9ca4d859e1ff2e79fbbe4f4', 'request_id': 'req-68dfa822-33a3-40c8-a0c6-1a0518afe153'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:19.221162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] The token cache is being invalidate because project a313baebe9ca4d859e1ff2e79fbbe4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:17:19.221432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:19.222189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-68dfa822-33a3-40c8-a0c6-1a0518afe153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:19.223752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 753/1512] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:17:19 2021] DELETE /identity/v3/projects/a313baebe9ca4d859e1ff2e79fbbe4f4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:49.590722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.591595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.591595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.594325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 760/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:18:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:18:49.601469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07db6-90d9-460f-964e-7b5e2a8fc88e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.602178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07db6-90d9-460f-964e-7b5e2a8fc88e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.602283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07db6-90d9-460f-964e-7b5e2a8fc88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.623069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-90a07db6-90d9-460f-964e-7b5e2a8fc88e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:49.624272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-90a07db6-90d9-460f-964e-7b5e2a8fc88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.689786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 754/1514] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:49.852307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:49.855551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.945862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f5bf3-904b-4c1f-ac73-04f0d9889b06 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:49.953552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:49.954256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.954530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.954802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.964843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:49.966430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca931c2-cce7-4afb-84d7-55fa771458f8 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:49.976287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 761/1515] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:50.106015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82b91-7ac8-45c6-a612-784c02fb8083 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:50.106248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82b91-7ac8-45c6-a612-784c02fb8083 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:50.106432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82b91-7ac8-45c6-a612-784c02fb8083 None None] PATH_INFO: `/v3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:50.107787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 755/1516] 10.222.0.70 () {54 vars in 925 bytes} [Wed Dec 15 16:18:50 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:50.115746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256411ec-5fb5-4f94-8c44-b222495341aa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:50.116016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256411ec-5fb5-4f94-8c44-b222495341aa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:50.116310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256411ec-5fb5-4f94-8c44-b222495341aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:50.136903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-256411ec-5fb5-4f94-8c44-b222495341aa None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:50.138114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-256411ec-5fb5-4f94-8c44-b222495341aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:50.204759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 762/1517] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Dec 15 16:18:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:51.476948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa932-2d6a-413d-8790-df94ede6db9e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:51.477524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa932-2d6a-413d-8790-df94ede6db9e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:51.477524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa932-2d6a-413d-8790-df94ede6db9e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:51.480145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 756/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:18:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:18:51.485795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46db6-f13e-4acd-91c2-2a6eb44f7623 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:51.486258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46db6-f13e-4acd-91c2-2a6eb44f7623 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:51.486364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46db6-f13e-4acd-91c2-2a6eb44f7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:51.505913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-dde46db6-f13e-4acd-91c2-2a6eb44f7623 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:51.507133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dde46db6-f13e-4acd-91c2-2a6eb44f7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:51.516469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 763/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:18:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:51.686284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafa932-2d6a-413d-8790-df94ede6db9e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:51.701666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafa932-2d6a-413d-8790-df94ede6db9e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:51.707780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:51.708466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:51.708741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:51.709015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:51.719132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:51.721173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208314e-9f48-42a9-98cf-a746147ff7c8 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:51.732022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 757/1520] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:54.051566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57361-b313-453f-82dc-bbd8a64b230b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:54.052157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57361-b313-453f-82dc-bbd8a64b230b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:54.052157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57361-b313-453f-82dc-bbd8a64b230b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:54.053982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 764/1521] 10.222.0.30 () {54 vars in 960 bytes} [Wed Dec 15 16:18:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:18:54.060913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaeb0-e19c-4c6c-afed-49717b947174 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:54.061441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaeb0-e19c-4c6c-afed-49717b947174 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:54.061441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaeb0-e19c-4c6c-afed-49717b947174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:54.081581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b8baaeb0-e19c-4c6c-afed-49717b947174 None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:54.082854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b8baaeb0-e19c-4c6c-afed-49717b947174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:54.093444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 758/1522] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Dec 15 16:18:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:54.101948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f57361-b313-453f-82dc-bbd8a64b230b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:54.116860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f57361-b313-453f-82dc-bbd8a64b230b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:54.122082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:54.122991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:54.122991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:54.123288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:54.132518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:54.134150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018cca4-a224-455e-9a2a-c7f8ba53bca0 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:54.144352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 765/1523] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:03.701612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b7b-dd49-4d4a-a7f3-2b14158b1d71 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:03.702666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b7b-dd49-4d4a-a7f3-2b14158b1d71 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:03.702666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b7b-dd49-4d4a-a7f3-2b14158b1d71 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:03.705525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 759/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:19:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:03.713700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f99-801e-4e79-9336-61184af2b117 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:03.714188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f99-801e-4e79-9336-61184af2b117 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:03.714302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f99-801e-4e79-9336-61184af2b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:03.734977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-90670f99-801e-4e79-9336-61184af2b117 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:03.736202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-90670f99-801e-4e79-9336-61184af2b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:03.745358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 766/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:03.905251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8b7b-dd49-4d4a-a7f3-2b14158b1d71 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:03.928529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8b7b-dd49-4d4a-a7f3-2b14158b1d71 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:03.935624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:03.936269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:03.936575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:03.936848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:03.951767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:03.954107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19727645-db3e-49f8-93d9-2e6b778f77e2 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:03.965227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 760/1526] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:05.470773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840593-df67-447c-b8b3-b8d8665a0d9a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:05.471573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840593-df67-447c-b8b3-b8d8665a0d9a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:05.471573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840593-df67-447c-b8b3-b8d8665a0d9a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:05.474108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 767/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:19:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:05.482783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60799-197a-40e5-91ed-e1b37d319d36 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:05.483228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60799-197a-40e5-91ed-e1b37d319d36 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:05.483336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60799-197a-40e5-91ed-e1b37d319d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:05.504987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-21d60799-197a-40e5-91ed-e1b37d319d36 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:05.507026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-21d60799-197a-40e5-91ed-e1b37d319d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:05.517831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 761/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:19:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:05.690582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840593-df67-447c-b8b3-b8d8665a0d9a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:05.706473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840593-df67-447c-b8b3-b8d8665a0d9a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:05.713597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:05.714486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:05.714765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:05.715107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:05.727757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:05.729354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ba489-0f83-4a1d-8435-5e7810c7f877 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:05.739807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 768/1529] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:10.258496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:10.262577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:10.262872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:10.264726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 762/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:19:10 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:10.272548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bcfe3-c45f-4997-80d6-d16bae137cf4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:10.273170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bcfe3-c45f-4997-80d6-d16bae137cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:10.273269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bcfe3-c45f-4997-80d6-d16bae137cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:10.294094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4f8bcfe3-c45f-4997-80d6-d16bae137cf4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:10.295307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4f8bcfe3-c45f-4997-80d6-d16bae137cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:10.303749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 769/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:19:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:10.341963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:10.343976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:10.403963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649174a2-43b9-488b-9ef7-4bebf2fd7811 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:10.408137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:10.408865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:10.409146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:10.409400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:10.419803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:10.421531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c625-d8a1-4e16-addb-c8969bcc8317 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:10.431287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 763/1532] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:12.816901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffa7b-daaa-42c0-b4bc-f8b1a27bea02 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:12.817747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffa7b-daaa-42c0-b4bc-f8b1a27bea02 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:12.817747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffa7b-daaa-42c0-b4bc-f8b1a27bea02 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:12.820392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 770/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:19:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:12.826812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e9ec-5d92-4f12-9fbc-8d40d5c00570 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:12.827254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e9ec-5d92-4f12-9fbc-8d40d5c00570 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:12.827378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e9ec-5d92-4f12-9fbc-8d40d5c00570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:12.846863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c761e9ec-5d92-4f12-9fbc-8d40d5c00570 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:12.848169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c761e9ec-5d92-4f12-9fbc-8d40d5c00570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:12.858446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 764/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:19:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:12.898465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffa7b-daaa-42c0-b4bc-f8b1a27bea02 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:12.915583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffa7b-daaa-42c0-b4bc-f8b1a27bea02 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:12.922189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:12.923066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:12.923415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:12.923775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:12.934654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:12.936089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e898b-e061-4438-a557-3644ef8303d9 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:12.946079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 771/1535] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:17.024846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:17.025462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:17.025462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:17.027194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 765/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:17.033183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae29a-67de-4a30-88d6-88dfca38d2c0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:17.033644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae29a-67de-4a30-88d6-88dfca38d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:17.033862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae29a-67de-4a30-88d6-88dfca38d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:17.055823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4c8ae29a-67de-4a30-88d6-88dfca38d2c0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:17.057067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4c8ae29a-67de-4a30-88d6-88dfca38d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:17.065730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 772/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:19:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:17.117961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:17.119903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:17.180090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0137-dfae-4100-8e47-4b8d7197f113 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:17.184210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:17.184899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:17.185303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:17.185581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:17.195360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:17.196854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcff8bc-8cc6-4abe-bb8c-2fcfc0f7bb2c service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:17.206344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 766/1538] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:19.622523 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf591-9f6d-4440-b3b9-2f23449ac746 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:19.623123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf591-9f6d-4440-b3b9-2f23449ac746 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:19.623123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf591-9f6d-4440-b3b9-2f23449ac746 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:19.625906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 773/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:19:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:19.637187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920fe1-77f3-4aea-8ee1-73f359520141 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:19.637647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920fe1-77f3-4aea-8ee1-73f359520141 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:19.637782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920fe1-77f3-4aea-8ee1-73f359520141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:19.662648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5d920fe1-77f3-4aea-8ee1-73f359520141 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:19.664489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5d920fe1-77f3-4aea-8ee1-73f359520141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:19.677861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 767/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:19:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:19:19.729158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773a1e-99e3-4ad8-af22-84a8d8b10e34 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:19.729423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773a1e-99e3-4ad8-af22-84a8d8b10e34 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:19.729645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773a1e-99e3-4ad8-af22-84a8d8b10e34 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:19.731411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 774/1541] 10.222.0.30 () {54 vars in 963 bytes} [Wed Dec 15 16:19:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:19:19.737243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07b9-fb6f-4878-9c99-6d8060d64bb5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:19.737606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07b9-fb6f-4878-9c99-6d8060d64bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:19.737820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b07b9-fb6f-4878-9c99-6d8060d64bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:19.758451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fa0b07b9-fb6f-4878-9c99-6d8060d64bb5 None None] MFA Rules not processed for user `ab5f4ed434ad4685a93229ce1b6aef3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:19.759649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa0b07b9-fb6f-4878-9c99-6d8060d64bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:19.767295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 768/1542] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Dec 15 16:19:19 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:19.777014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3773a1e-99e3-4ad8-af22-84a8d8b10e34 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:19.795695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3773a1e-99e3-4ad8-af22-84a8d8b10e34 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:19.802881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:19.804036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:19.804520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:19.804801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:19.818432 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:19.819343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f1fdc-04fe-4ec5-88b3-2c8e4401aa98 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:19.829735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 775/1543] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:42.117502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.119017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.119536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.149557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.151210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.162918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 769/1544] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.171948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.172572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.172572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.205681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.207208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.216970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 776/1545] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.223852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.240179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a522e-45a0-4ec5-8e53-29f048294703 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.252408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.253600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.254054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.254496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.255418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:42.256354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.257958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.278056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 770/1546] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:42.287184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.297443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd746e-41f6-4cfd-83e8-6895436c7ded None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.309606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.310878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.310878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.311282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.312029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.314107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.365811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 777/1547] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:42.370457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.385816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129226-8d5b-439d-8deb-085f09aea93e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.459824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.461210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.461688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.462174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.463365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.465559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.493530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 771/1548] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:42.498079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.515048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d02999-cfa1-4893-94e4-c254effde2e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.528957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.529660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.529944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.530234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.531215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.533080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.551751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 778/1549] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:42.556938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.570042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d810-7995-4e27-8900-be6a9c36a598 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.577961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.578990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.579633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.580131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.581192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.583062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e86b1-5db4-41c3-bb64-3e52445e7b22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.599075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 772/1550] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:42.604036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.617040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff588-540d-4846-a1ee-37b25a8142fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.618542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0c5f-6afc-41a5-a7e3-f10994989631 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.619322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0c5f-6afc-41a5-a7e3-f10994989631 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.619840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0c5f-6afc-41a5-a7e3-f10994989631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.627313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.628226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.628534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.628815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] PATH_INFO: `/v3/projects/f5fe7f126c8b4c95aafeac8597ec3fd3/users/292523828a59427abd269133c396290e/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.654122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fe7f126c8b4c95aafeac8597ec3fd3, user_id=292523828a59427abd269133c396290e, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.661547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f43c0c5f-6afc-41a5-a7e3-f10994989631 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.661547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f43c0c5f-6afc-41a5-a7e3-f10994989631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.661799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3d36-d16c-4324-b836-e084fdf29402 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.678241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 773/1551] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.680080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5477-dc5e-41a7-8980-7a1e47282a11 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.680759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5477-dc5e-41a7-8980-7a1e47282a11 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.681320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5477-dc5e-41a7-8980-7a1e47282a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.681768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 779/1552] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:42 2021] PUT /identity/v3/projects/f5fe7f126c8b4c95aafeac8597ec3fd3/users/292523828a59427abd269133c396290e/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:42.686820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c950-77e2-42d5-a34a-9475fbfe1080 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.687370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c950-77e2-42d5-a34a-9475fbfe1080 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.687660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c950-77e2-42d5-a34a-9475fbfe1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.709473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-99bb5477-dc5e-41a7-8980-7a1e47282a11 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.711085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-99bb5477-dc5e-41a7-8980-7a1e47282a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.722255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-42e5c950-77e2-42d5-a34a-9475fbfe1080 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.723656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-42e5c950-77e2-42d5-a34a-9475fbfe1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.799258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 780/1553] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:42.800697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abbdb5-be07-4280-9033-fdeb2ae53f5b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.800991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abbdb5-be07-4280-9033-fdeb2ae53f5b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.801269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abbdb5-be07-4280-9033-fdeb2ae53f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.815502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 774/1554] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.818948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.818948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.818948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.822098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f3abbdb5-be07-4280-9033-fdeb2ae53f5b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.823717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f3abbdb5-be07-4280-9033-fdeb2ae53f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.835050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 781/1555] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.836209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048fb0e-f84a-4ab4-ba2b-2cc8986e13d9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.836978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048fb0e-f84a-4ab4-ba2b-2cc8986e13d9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.836978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048fb0e-f84a-4ab4-ba2b-2cc8986e13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.847709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] MFA Rules not processed for user `292523828a59427abd269133c396290e`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.848939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.855394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7048fb0e-f84a-4ab4-ba2b-2cc8986e13d9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.856651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7048fb0e-f84a-4ab4-ba2b-2cc8986e13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.866708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 782/1556] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.868101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8460a-3ae5-4f95-b7f7-59e118937c3a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.868387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8460a-3ae5-4f95-b7f7-59e118937c3a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.868699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8460a-3ae5-4f95-b7f7-59e118937c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.887895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49e8460a-3ae5-4f95-b7f7-59e118937c3a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.889052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49e8460a-3ae5-4f95-b7f7-59e118937c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.897442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 783/1557] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.898805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d568-d3e7-4812-9a1f-946f189e67a1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.899089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d568-d3e7-4812-9a1f-946f189e67a1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.899367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d568-d3e7-4812-9a1f-946f189e67a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.918760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-de20d568-d3e7-4812-9a1f-946f189e67a1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.919997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de20d568-d3e7-4812-9a1f-946f189e67a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.922106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 775/1558] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.923028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:42.931844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 784/1559] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.933286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168224ae-6173-4ad7-b843-cecf7603045e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.933571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168224ae-6173-4ad7-b843-cecf7603045e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.933851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168224ae-6173-4ad7-b843-cecf7603045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.940751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad12bc-378a-49a7-a068-702acf9d4c27 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:42.945985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:42.946600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.946884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.947157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.947919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:42.948318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:42.950046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54014-9878-4f9d-b1d8-517e53c064e2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:42.957808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-168224ae-6173-4ad7-b843-cecf7603045e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.959060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-168224ae-6173-4ad7-b843-cecf7603045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.966540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 776/1560] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:42.966540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1b97-a5c6-4fe4-a764-77a9a3e194a8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.966540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1b97-a5c6-4fe4-a764-77a9a3e194a8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.966540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1b97-a5c6-4fe4-a764-77a9a3e194a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.974749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 785/1561] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:42.974749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40452c-ef6e-46ad-9854-d623c51eff86 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:42.974749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40452c-ef6e-46ad-9854-d623c51eff86 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:42.974749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40452c-ef6e-46ad-9854-d623c51eff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:42.990665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5e3c1b97-a5c6-4fe4-a764-77a9a3e194a8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.991904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5e3c1b97-a5c6-4fe4-a764-77a9a3e194a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:42.992503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-af40452c-ef6e-46ad-9854-d623c51eff86 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:42.993703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af40452c-ef6e-46ad-9854-d623c51eff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.000010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 777/1562] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.001618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3a40-cc43-430e-be1c-fa5ef2856ced None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.001757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 786/1563] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.001995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3a40-cc43-430e-be1c-fa5ef2856ced None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.002360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3a40-cc43-430e-be1c-fa5ef2856ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.002928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fe92-0766-45ec-9255-7d8d182a041c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.003222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fe92-0766-45ec-9255-7d8d182a041c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.003516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fe92-0766-45ec-9255-7d8d182a041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.021635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0ea3fe92-0766-45ec-9255-7d8d182a041c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:43.022859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0ea3fe92-0766-45ec-9255-7d8d182a041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.026801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-51fb3a40-cc43-430e-be1c-fa5ef2856ced None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:43.027944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-51fb3a40-cc43-430e-be1c-fa5ef2856ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.030850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 787/1564] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.032095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.032509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.032824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.041563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 778/1565] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.042783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b7f3-201b-4804-859d-1d63804e08ce None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.043067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b7f3-201b-4804-859d-1d63804e08ce None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.043341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b7f3-201b-4804-859d-1d63804e08ce None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.045329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 779/1566] 10.222.0.30 () {54 vars in 961 bytes} [Wed Dec 15 16:20:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:20:43.046192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678b7f3-201b-4804-859d-1d63804e08ce None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.052603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:43.053826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.059591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678b7f3-201b-4804-859d-1d63804e08ce None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.061752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 788/1567] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.062571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.067871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.068515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.068798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.069074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.069804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.071787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.075220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820fe0b-becf-40e4-a52e-869d997e6b99 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.080119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.080860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.081145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.081423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.082193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.082498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.084172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad45a50-d9c6-49a8-a67d-227931ce5386 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.097348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 789/1568] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.099076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.099547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.099831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.110803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 780/1569] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.110803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.124553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:43.125775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.171586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623166a-ec32-446a-a003-1c235f6466fc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.176759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.177458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.177715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.177981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.178727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.179030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.180697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.186508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 790/1570] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.187398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.194663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 781/1571] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.195469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.197421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a215-c988-44c5-b120-1ac9152c7d60 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.201955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.202629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.202913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.203189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.203933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.204238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.205524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c817d-464c-4487-a20e-f964c4716848 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.206230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b761cd-e24b-49c3-bcbf-0f0c4c939cb7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.210146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.210822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.211082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.211351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.212151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.212464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.214098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.221657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 791/1572] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.221657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.221657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.221657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.226552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 782/1573] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.227764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.243307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97606d9-64e3-419f-aa6c-ffcdb113b474 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.244756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:43.246012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:43.248674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.249347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.249627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.249901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.250664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.250983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.253035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.267976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 783/1574] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.268924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.278713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f235d7-5df5-493d-aaa8-2e6cda30268a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.283491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.284230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.284566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.285003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.285715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.287619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.317253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 784/1575] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.321518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.321953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 792/1576] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:43.322865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.333098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba1237-1c65-4dff-83c3-37b044f25add None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.385575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1363ce-6ec8-4031-ad36-cc87c9d7f0f3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.387043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.387776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.388052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.388322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.389115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:43.389412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.390232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.390914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.391021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.391196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.391499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.392721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.394629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.403615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 793/1577] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:20:43.404405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.415757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878868-9e20-480e-95be-8c6576438f83 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.420517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.421134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 785/1578] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.421261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.422134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.424422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.424737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.425468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.427390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.432038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabd3b1-62be-4ba5-8045-cd10e75198f8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.436541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.437199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.437478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.437999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.438443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.440395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.455076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 794/1579] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.455942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.470703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 786/1580] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.471940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.517583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd8a-b108-445d-8935-77945ea016a8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.533870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d942c-61e9-4c19-8b37-c015e029c9aa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.538769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.539414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.539695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.539975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.540726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.542643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.570684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 787/1581] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.574564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.575035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.575801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.576079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.576416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.577175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.579936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.612156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 795/1582] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.612156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.639765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20cc58-6132-4a70-9f88-dcd5cf482de2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.683837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e66a52-c1ab-40df-bb8c-7464a0ddeb24 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.690037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.690696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.690973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.691245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.695647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.696332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.696637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.696916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.697621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.699579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.721161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 788/1583] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.721739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.735344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1b55-7023-446e-9471-7c48e43def0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.740254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.740983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.741277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.741682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.742428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.744452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.750322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.751961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.761448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 796/1584] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:43.762296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.772124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 789/1585] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.773249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.774361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2b1b-4e9b-4931-aa25-ffe8e233c141 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.833749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.834492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.834778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.835053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.835802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.837593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.838976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113067f-8c88-425d-80bb-e8f4ba1f1385 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.844267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.845063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.845390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.845667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.846383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.850926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 797/1586] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:43.851083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.851198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.862591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd5f8-ddb1-4312-81ce-d7de1a11a4e6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.868304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.869025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.869323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.869586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.870296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.872225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.876709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 790/1587] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.876709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.885274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd25de-ac17-4b9d-8583-c627a865a17a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.890310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.891233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.891233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.891536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.892257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.894278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.903924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 798/1588] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 284 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.905007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.916648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 791/1589] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.916878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0bad-10c5-427c-bbd5-ac33aeda01b8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.921266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.924677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.925381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.925661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.925941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.926657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.928630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.931649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853700e5-1bc8-4cec-a810-66f518708319 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.936317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.937012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.937288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.937897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.938297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.939997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.953167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 799/1590] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:43.956480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.956667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 792/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:43.957511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:43.967756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043e79d-a23d-47ae-be79-df2889476eb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.968376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3019d0b-7556-47f7-bdcf-3818b212ac57 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:43.973390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.974061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.974342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.974577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:43.974726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.975356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:43.975473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.975685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:43.976030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:43.977213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:43.977342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.979177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:43.988729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 793/1592] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:43.988729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.002646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1da339-4a48-42c5-8677-508b092af8a5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.008904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 800/1593] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:43 2021] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:44.010035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.011339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.012321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.012723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.012986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.013737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.015326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.021206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d36c6-99f6-4178-83d8-645364e49e65 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.025730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 794/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.025951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.026567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.026763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.027056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.027348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.028079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.029769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.038652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b530-9ba0-4f26-be4b-fda98a7d0905 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.043270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.043838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 801/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.043972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.044225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.044500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.045252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.045483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.046910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.055791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87036fb6-1baf-4557-93ee-6e5750caff25 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.058649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 795/1596] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.059506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.063983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.064697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.064982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.065257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.066003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.067606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.071232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cc11-3927-4fe7-a656-823913fc514c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.075842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.076545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.076829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.077104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.077781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 802/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.077907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.078662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.079538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617b1fe-44b7-44ac-aff4-50250f65bf9e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.089083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426307c-0b12-409d-9c67-2e6ea5601383 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.090786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 796/1598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.090786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088639-d6c1-4e64-ad18-c44e436d5824 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.090786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088639-d6c1-4e64-ad18-c44e436d5824 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.092751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088639-d6c1-4e64-ad18-c44e436d5824 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.094446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 797/1599] 10.222.0.30 () {54 vars in 912 bytes} [Wed Dec 15 16:20:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:20:44.097730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.098696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.098967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.099216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] PATH_INFO: `/v3/projects/4bb083b5a25444b3845b0f49b8b6f4d6/users/b7f047bf1080497290a18bff8b4e4337/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.099856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088639-d6c1-4e64-ad18-c44e436d5824 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.113393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088639-d6c1-4e64-ad18-c44e436d5824 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.116170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb083b5a25444b3845b0f49b8b6f4d6, user_id=b7f047bf1080497290a18bff8b4e4337, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.118888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.121109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.121994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.122924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.122924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.123878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.125859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.134356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 803/1600] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/4bb083b5a25444b3845b0f49b8b6f4d6/users/b7f047bf1080497290a18bff8b4e4337/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.135352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.139876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 798/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.139876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.148096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b1db4-64e5-41ab-a8d6-2286fb961192 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.204384 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.205382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b996f-9cf6-4236-aaf5-400aa48c0fc6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.206924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.206924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.206924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.207460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.210383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.212852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.213814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.214240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.214676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.215927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.218704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.228012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 799/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.229064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.237769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 804/1603] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.241395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e20-ebcf-480e-8ea2-b3f4f41aaf24 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.242349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.246775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.247435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.247890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.248303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.248945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.250568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.253111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3215-f6e2-4ab7-8154-7df7e07ba971 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.258075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.258760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.259040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.259356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.260052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.261808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16769ae1-4cb3-4a52-a5d4-09ddbc8760fd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.262096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 800/1604] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.262946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.273383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 805/1605] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.274905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.275194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.275471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.276721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec3276-b563-4197-a9dd-20e7aece8f95 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.281402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.282284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.282702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.283193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] PATH_INFO: `/v3/projects/f53b51bf484d4b4b99e6143a1cbfb524/users/b808c98d10924e52b059963c1cd62752/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.293990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:44.295322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:44.297942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53b51bf484d4b4b99e6143a1cbfb524, user_id=b808c98d10924e52b059963c1cd62752, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.301129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd924f9-66d6-4bae-9e87-3da9ca8014af admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.315894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 801/1606] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/f53b51bf484d4b4b99e6143a1cbfb524/users/b808c98d10924e52b059963c1cd62752/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.317539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.317872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.318200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.336830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:44.338080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:44.375084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 806/1607] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:44.375976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.388203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad67598-74f4-4315-b634-8dbbd9972458 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.402215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 802/1608] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:44.405361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.416234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335239-3535-4623-9e55-87f7bd8a57b9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.421009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.421935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.422209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.422481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] PATH_INFO: `/v3/projects/ce9b3832783f421ab1f5762ebca1d6f7/users/33aa48b6003442818648eb57b6100ea5/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.440142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9b3832783f421ab1f5762ebca1d6f7, user_id=33aa48b6003442818648eb57b6100ea5, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.442890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.448694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.449470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.449855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.450190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.451046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.452776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.458182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 803/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/ce9b3832783f421ab1f5762ebca1d6f7/users/33aa48b6003442818648eb57b6100ea5/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.458907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.465067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 807/1610] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:44.469465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.479981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ea5d1-2b4e-4206-8bcf-5d1e374f5ece admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.526558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb550-592f-4800-a758-01f7baf0ee6b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.531676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.532716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.533148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.533331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] PATH_INFO: `/v3/projects/8b5ed861193f4a1a8f0c5814d631c51e/users/2a98a4c40dd04561ace2576e8b333657/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.538453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.539577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.539870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.540146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] PATH_INFO: `/v3/projects/e9ae5987d1de44528de1dd4b294163e7/users/ce7c215641ad44bb88ffee42c4ffca91/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.547721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5ed861193f4a1a8f0c5814d631c51e, user_id=2a98a4c40dd04561ace2576e8b333657, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.550641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.555730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae5987d1de44528de1dd4b294163e7, user_id=ce7c215641ad44bb88ffee42c4ffca91, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.559037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a825b-96dc-4ace-a0af-5a734c56d8c4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.567012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 804/1611] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/8b5ed861193f4a1a8f0c5814d631c51e/users/2a98a4c40dd04561ace2576e8b333657/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.568182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.576402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 808/1612] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/e9ae5987d1de44528de1dd4b294163e7/users/ce7c215641ad44bb88ffee42c4ffca91/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.582162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.582488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.582721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.610600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] MFA Rules not processed for user `b808c98d10924e52b059963c1cd62752`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:44.611837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:44.630829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebf4e4-3672-4455-b089-4ed671a9530f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.676489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 809/1613] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:44.677567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.690702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.690702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.690702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.690702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] PATH_INFO: `/v3/projects/4fe8b4fae71c484f939fd5379ad2ff16/users/17203383b6ed406a959b7a93cf184c4d/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.705778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe8b4fae71c484f939fd5379ad2ff16, user_id=17203383b6ed406a959b7a93cf184c4d, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.708591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.723462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 805/1614] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/4fe8b4fae71c484f939fd5379ad2ff16/users/17203383b6ed406a959b7a93cf184c4d/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.724416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.732037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89cc6-9fda-48fe-88c6-2b5eee010ded None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.779413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1762d-7c51-4e61-8ec6-a868af7e34b2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.780780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.781512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.781725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.781987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.784329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.785093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.785368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.785637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.847717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.849363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.857066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.858527 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29bdd-ad4e-4ae6-9b0c-b6b47d384af3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.859277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 806/1615] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:44.860096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:44.869500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9003-81b9-403a-b9d3-05208bb618d8 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:44.871650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 810/1616] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:44 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:44.873807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4328a-dbac-4699-89f5-5b1dc98860ad None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.874291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4328a-dbac-4699-89f5-5b1dc98860ad None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.874816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4328a-dbac-4699-89f5-5b1dc98860ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.880052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:44.881410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.881689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.881960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] PATH_INFO: `/v3/projects/0d66ed76bcb74b45acc60dc6a0c965f1/users/7221014c51874578aaaf6f78e5327d70/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.898698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d66ed76bcb74b45acc60dc6a0c965f1, user_id=7221014c51874578aaaf6f78e5327d70, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:44.901415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dcdc5-4e59-4379-8db7-7cbc99d4c1a6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:44.914095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bbd4328a-dbac-4699-89f5-5b1dc98860ad None None] MFA Rules not processed for user `33aa48b6003442818648eb57b6100ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:44.915343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bbd4328a-dbac-4699-89f5-5b1dc98860ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:44.919253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 807/1617] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:44 2021] PUT /identity/v3/projects/0d66ed76bcb74b45acc60dc6a0c965f1/users/7221014c51874578aaaf6f78e5327d70/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:44.924780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.925068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.925437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:44.945715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:44.947505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:44.996092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 811/1618] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:44.997743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1cb9e-20fe-4f03-96fd-0b8210f243c7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:44.998034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1cb9e-20fe-4f03-96fd-0b8210f243c7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:44.998318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1cb9e-20fe-4f03-96fd-0b8210f243c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.035334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d0a1cb9e-20fe-4f03-96fd-0b8210f243c7 None None] MFA Rules not processed for user `ce7c215641ad44bb88ffee42c4ffca91`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:45.036994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d0a1cb9e-20fe-4f03-96fd-0b8210f243c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:45.039731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 808/1619] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:45.040923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.051447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541434d-7a6f-4541-8f9b-e4716efc8cef None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.056929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.057626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.057910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.058305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.059290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.061354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43898d3e-cf5b-454d-8edb-0b4e94b456ea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.101632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 809/1620] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:45 2021] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:45.101632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.101632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.101632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.125257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:45.126608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:45.144615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 812/1621] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:45.149093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.151492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.151888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.178417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:45.180503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:45.218304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 810/1622] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:45.221341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.287518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 813/1623] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:45.291397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.292971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:45.336010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6f30-c619-4332-9dd8-40babcb5e385 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.339829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.341003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.341003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.341271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.377031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc9bd6-e7ad-4ca5-989a-a54428d70a9a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.382519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.383619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.384635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.385201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.398866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.401516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.415176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.416399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 814/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:45.417064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85abba4-1dc5-45d0-a5c5-4bf298c28e3c service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.417797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.429148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 811/1625] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:45.430960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d66e-b338-4612-ad6f-27ff5d6e5785 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.431494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d66e-b338-4612-ad6f-27ff5d6e5785 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.436350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d66e-b338-4612-ad6f-27ff5d6e5785 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.439556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 812/1626] 10.222.0.30 () {54 vars in 961 bytes} [Wed Dec 15 16:20:45 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:20:45.440342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b6db-3f34-4d38-a53c-40a853f2c26e service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.440870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11d66e-b338-4612-ad6f-27ff5d6e5785 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.457009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11d66e-b338-4612-ad6f-27ff5d6e5785 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.457267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41770860-7718-4357-a17f-a669687d430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.457772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770860-7718-4357-a17f-a669687d430c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.458165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770860-7718-4357-a17f-a669687d430c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.458451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770860-7718-4357-a17f-a669687d430c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.459173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41770860-7718-4357-a17f-a669687d430c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.462206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.462379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41770860-7718-4357-a17f-a669687d430c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.462961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.463510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.464223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.479556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.481501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.495434 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 813/1627] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:45.497367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.507225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd880-9b27-40c0-af90-cff61a47bee9 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.512404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.512843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 815/1628] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:45 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:45.513956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.514161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.514417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.514690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.515102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.515591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.530666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.534092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.546683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 814/1629] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:45.552724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:45.553836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:45.556727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.587756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b7076-4c20-4d91-80d7-c16acbdc3e2c service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.612065 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.613084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.613619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.617392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.618501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.630130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.647915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 816/1630] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Dec 15 16:20:45 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:45.657016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.663301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 815/1631] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:45.670972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.676149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2f15c-373f-4d2e-bc3e-b0128121c35c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.682104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.682769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.683234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.683671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.711169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54307-daac-4a94-9426-45e923d7803b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:45.730843 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:45.734484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:45.737385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:45.739169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] PATH_INFO: `/v3/projects/9b53f668271f413195eeef4e82a1fb41/users/65131610efdf4d16bf83a679536f3d60/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:45.800733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b53f668271f413195eeef4e82a1fb41, user_id=65131610efdf4d16bf83a679536f3d60, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.806624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.840082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 816/1632] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:45 2021] PUT /identity/v3/projects/9b53f668271f413195eeef4e82a1fb41/users/65131610efdf4d16bf83a679536f3d60/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:45.844694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:45.874249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:45.877231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:45.933160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 817/1633] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:46.002815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c08c2-49be-4cfa-a375-d29856e268fa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:46.018142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:46.020059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.020480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.021243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.024000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:46.026817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af5a3-7be9-4e12-b518-502004636e83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:46.067522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 817/1634] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:45 2021] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:46.071605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:46.122878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1746d9-81d5-40d2-8d53-0f785c5d647a service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:46.147087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:46.148702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.157188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.157820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] PATH_INFO: `/v3/projects/9b53f668271f413195eeef4e82a1fb41/users/65131610efdf4d16bf83a679536f3d60/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.170170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b53f668271f413195eeef4e82a1fb41, user_id=65131610efdf4d16bf83a679536f3d60, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:46.175660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:46.243479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 818/1635] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:46 2021] PUT /identity/v3/projects/9b53f668271f413195eeef4e82a1fb41/users/65131610efdf4d16bf83a679536f3d60/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:46.253256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136c8e-217e-4b3e-961a-38e8951eacae None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.253901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136c8e-217e-4b3e-961a-38e8951eacae None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.253901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136c8e-217e-4b3e-961a-38e8951eacae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.327214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-86136c8e-217e-4b3e-961a-38e8951eacae None None] MFA Rules not processed for user `65131610efdf4d16bf83a679536f3d60`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:46.332039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-86136c8e-217e-4b3e-961a-38e8951eacae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:46.512516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 818/1636] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:46 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:46.524981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:46.647860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4775-e108-4494-8d5a-9787febc3268 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.648341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4775-e108-4494-8d5a-9787febc3268 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.648899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4775-e108-4494-8d5a-9787febc3268 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.652580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 819/1637] 10.222.0.30 () {54 vars in 912 bytes} [Wed Dec 15 16:20:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:20:46.665636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cb75-cc00-4f11-84c8-ed67ed868c81 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.666097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cb75-cc00-4f11-84c8-ed67ed868c81 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.666649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cb75-cc00-4f11-84c8-ed67ed868c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.706746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-36f9cb75-cc00-4f11-84c8-ed67ed868c81 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:46.713648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-36f9cb75-cc00-4f11-84c8-ed67ed868c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:46.732286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e2e-ade6-4831-992b-dec672bc0f2f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:46.748036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:46.750950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.752579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.754061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:46.797975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:46.802952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:46.845525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 819/1638] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:46 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:46.928988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 820/1639] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:20:46 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:46.948114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:46.972004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a2cff-9ed6-4795-9e19-1f3df6cac329 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:46.993244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:46.994511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:46.995115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:46.995738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:47.038219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:47.041360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f8750-49ff-46ae-bd98-90d752029038 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:47.055582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:47.055873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:47.056150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:47.064066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 820/1640] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:47.184763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] MFA Rules not processed for user `7221014c51874578aaaf6f78e5327d70`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:47.186731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:47.536884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 821/1641] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:47 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:47.542529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:47.544268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:47.545811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:47.582374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] MFA Rules not processed for user `7221014c51874578aaaf6f78e5327d70`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:47.586087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:47.615166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 821/1642] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:47 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:47.649404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:47.682651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8de4-b336-40ba-9842-a704952a643e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:47.699207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:47.703230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:47.705024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:47.706035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:47.831865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:47.836494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db42e-b295-4a9a-9728-e6dcca4ddbcd service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:47.846571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 822/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:47 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:48.129027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:48.164804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289acd-16a2-4777-b7c6-6af64837dc2e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:48.194594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:48.195403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:48.195753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:48.196091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:48.198889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:48.199264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:48.199467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:48.226335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:48.228348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:48.256314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] MFA Rules not processed for user `2a98a4c40dd04561ace2576e8b333657`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:48.257182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:48.270319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 822/1644] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:48 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:48.360408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 823/1645] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:48 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:48.364929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:48.554261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ef33-2df7-4e7f-a630-ad5bce2f780a service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:48.569728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:48.572331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:48.574251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:48.574759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:48.575686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:48.579031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:48.647964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 823/1646] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:48 2021] POST /identity/v3/projects => generated 405 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:20:48.658430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:48.705757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134b633-13f8-41e2-8bd3-f75a8597d05e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.020002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.021156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.021652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.022829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.024316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.027785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.092041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 824/1647] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:48 2021] POST /identity/v3/users => generated 309 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:49.093461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:49.122244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76568995-5128-431a-89fc-6bc62e3effc3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.128972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.129807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.130196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.130589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.131545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.136129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9ee39-f5a7-4e96-9439-6c96d5a64abf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.170709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 824/1648] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:49.175825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:49.187295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce915-78bd-49c8-98ed-1d5869232d2c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.200783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.203189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.203666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.204145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] PATH_INFO: `/v3/projects/8978aa60f5f54578bdb5142a523330a6/users/66b1c910ad7442e1ac0678375e3710c8/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.223246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79cc53-8953-42e2-a8e4-f22bbe498cc5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.223742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79cc53-8953-42e2-a8e4-f22bbe498cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.224513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79cc53-8953-42e2-a8e4-f22bbe498cc5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.229127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 825/1649] 10.222.0.30 () {54 vars in 912 bytes} [Wed Dec 15 16:20:49 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:20:49.242007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.245149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.245655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.263960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8978aa60f5f54578bdb5142a523330a6, user_id=66b1c910ad7442e1ac0678375e3710c8, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.282651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.334233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 825/1650] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:49 2021] PUT /identity/v3/projects/8978aa60f5f54578bdb5142a523330a6/users/66b1c910ad7442e1ac0678375e3710c8/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:49.336581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:49.413213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:49.415325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:49.496870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b8ca-f13c-4d63-83c8-87abf522a886 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.503175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.504546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.505058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.505550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.506536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.508424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.529812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 826/1651] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:49 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:49.543606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:49.548956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 826/1652] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:20:49 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:49.558066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419db9-a6da-4024-b6f9-b25266c6f5e1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.644314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:49.645418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.645418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.645418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.645418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] PATH_INFO: `/v3/projects/8978aa60f5f54578bdb5142a523330a6/users/66b1c910ad7442e1ac0678375e3710c8/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.645865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8978aa60f5f54578bdb5142a523330a6, user_id=66b1c910ad7442e1ac0678375e3710c8, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.645958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42f20e-90dc-4239-a319-4783e4ca1ead None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:49.646043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.646133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:49.646133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:49.646133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:49.646133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:49.646456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:49.649277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de148cf7-06d8-48d8-bb45-963168b0c1dc service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:49.668577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 827/1653] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:20:49 2021] PUT /identity/v3/projects/8978aa60f5f54578bdb5142a523330a6/users/66b1c910ad7442e1ac0678375e3710c8/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:49.678635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 827/1654] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:50.775066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:50.981440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7238-c81f-4594-a1f3-93a89d44bea9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:50.998792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:50.999493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:50.999773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:51.000045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:51.008468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:51.075458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:51.083043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:51.114925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 828/1655] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:51.480761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98f6f-30a0-4b57-be9a-fa9e32aa382e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:51.481267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98f6f-30a0-4b57-be9a-fa9e32aa382e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:51.481352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98f6f-30a0-4b57-be9a-fa9e32aa382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:51.555009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-edf98f6f-30a0-4b57-be9a-fa9e32aa382e None None] MFA Rules not processed for user `66b1c910ad7442e1ac0678375e3710c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:51.561747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-edf98f6f-30a0-4b57-be9a-fa9e32aa382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:51.775388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 828/1656] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:51 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:54.161996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:54.535449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26db3-9655-419a-9fe5-f8c3f6033015 service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:54.545552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:54.547168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:54.549568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:54.550087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] PATH_INFO: `/v3/users/ce7c215641ad44bb88ffee42c4ffca91` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:54.553829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7c215641ad44bb88ffee42c4ffca91)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:54.555766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:54.555766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Dec 15 16:20:54.555766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: Dec 15 16:20:54.559597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:54.801400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7c215641ad44bb88ffee42c4ffca91'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:54.913668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7c215641ad44bb88ffee42c4ffca91'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:54.985009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7c215641ad44bb88ffee42c4ffca91'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:55.077406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7c215641ad44bb88ffee42c4ffca91'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:55.080950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7c215641ad44bb88ffee42c4ffca91'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:55.136981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 829/1657] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:20:54 2021] DELETE /identity/v3/users/ce7c215641ad44bb88ffee42c4ffca91 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:55.144952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcc4a-e310-4156-8cd6-c85338a0d733 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:55.146496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcc4a-e310-4156-8cd6-c85338a0d733 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:55.147251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcc4a-e310-4156-8cd6-c85338a0d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:55.212592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-623dcc4a-e310-4156-8cd6-c85338a0d733 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:55.214295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-623dcc4a-e310-4156-8cd6-c85338a0d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:55.325568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 829/1658] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:55.408799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:55.412128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:55.742181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9bb7d-9e0e-4d02-aec9-96b275db17ab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:55.760190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:55.764891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:55.765741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:55.767070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:55.815164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:55.823069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:55.826011 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:55.826427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:55.826801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:55.868897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 830/1659] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:55.876779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:55.879949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:55.982250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 830/1660] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:20:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:56.307529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:56.310133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:56.425365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d858500-ef17-4668-8cee-742bdfe6f368 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:56.426681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:56.430512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:56.454763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:56.459737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:56.460238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:56.460761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] PATH_INFO: `/v3/users/292523828a59427abd269133c396290e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:56.476777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=292523828a59427abd269133c396290e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:56.481414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:56.699373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292523828a59427abd269133c396290e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:56.730889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292523828a59427abd269133c396290e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:56.752049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292523828a59427abd269133c396290e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:56.761492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292523828a59427abd269133c396290e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:56.766709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f4f27eea-a8ba-4688-9e8b-5164297de70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292523828a59427abd269133c396290e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:56.781185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 831/1661] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:20:56 2021] DELETE /identity/v3/users/292523828a59427abd269133c396290e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:56.783212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:56.786807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:56.787252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:56.801632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a76f-152d-4b10-b918-1d9bc8fce777 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:56.897458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:56.898752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:57.127168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 832/1662] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:57.127669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:57.127669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:57.127669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:57.127669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:57.141066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:57.147059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:57.151476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:57.454573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f97ac5-cd7c-4f45-b7bc-465a45a53c22 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:57.456471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:57.458714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab035c-0e74-4c2f-82e3-1ebc23c1c804 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:57.468480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:57.469224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:57.469512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:57.469787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:57.501013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 831/1663] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:20:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1075 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:20:57.507474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:57.509624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:57.523031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:57.523031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:57.523468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:57.548478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 833/1664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:57.619943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] MFA Rules not processed for user `b7f047bf1080497290a18bff8b4e4337`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:57.632044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:58.013119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 832/1665] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:57 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:58.038413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:58.040113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:58.250687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4548-2703-4300-99ec-859740a98126 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:58.281650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:58.283358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:58.284728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:58.285071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:58.307669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:58.310084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:58.330660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 834/1666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:20:58 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:20:58.357716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:58.361087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:58.437740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eafc35-5f03-45e8-bdfd-34e62da6c79d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:58.455298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:58.457990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:58.460273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:58.460903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] PATH_INFO: `/v3/projects/f5fe7f126c8b4c95aafeac8597ec3fd3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:58.465562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fe7f126c8b4c95aafeac8597ec3fd3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:58.466905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:58.466905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Dec 15 16:20:58.466905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: Dec 15 16:20:58.472419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:58.477935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:58.481762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:58.537070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c712-b486-4f2d-aed0-13675f69b6c4 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:58.559255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:58.562231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:58.562534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:58.576725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] PATH_INFO: `/v3/projects/e9ae5987d1de44528de1dd4b294163e7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:58.578329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ae5987d1de44528de1dd4b294163e7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:58.581515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:58.677527 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fe7f126c8b4c95aafeac8597ec3fd3', 'request_id': 'req-3a41243b-9b38-47b4-88f4-8809c339ce3b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.697077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fe7f126c8b4c95aafeac8597ec3fd3', 'request_id': 'req-3a41243b-9b38-47b4-88f4-8809c339ce3b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.707736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fe7f126c8b4c95aafeac8597ec3fd3', 'request_id': 'req-3a41243b-9b38-47b4-88f4-8809c339ce3b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.708852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ae5987d1de44528de1dd4b294163e7', 'request_id': 'req-1740dd54-9f4b-48f0-8490-ba3db1d3c688'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.727720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ae5987d1de44528de1dd4b294163e7', 'request_id': 'req-1740dd54-9f4b-48f0-8490-ba3db1d3c688'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.760046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] The token cache is being invalidate because project f5fe7f126c8b4c95aafeac8597ec3fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:20:58.763068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.763902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ae5987d1de44528de1dd4b294163e7', 'request_id': 'req-1740dd54-9f4b-48f0-8490-ba3db1d3c688'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.766059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a41243b-9b38-47b4-88f4-8809c339ce3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.774134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 833/1667] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:20:58 2021] DELETE /identity/v3/projects/f5fe7f126c8b4c95aafeac8597ec3fd3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:58.783163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8f3f-b6d0-4251-9466-e1972eae3c4a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:58.784888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8f3f-b6d0-4251-9466-e1972eae3c4a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:58.785301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8f3f-b6d0-4251-9466-e1972eae3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:58.828157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-402c8f3f-b6d0-4251-9466-e1972eae3c4a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:58.832294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-402c8f3f-b6d0-4251-9466-e1972eae3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:58.847054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] The token cache is being invalidate because project e9ae5987d1de44528de1dd4b294163e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:20:58.850169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.854863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1740dd54-9f4b-48f0-8490-ba3db1d3c688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:20:58.881618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 835/1668] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:20:58 2021] DELETE /identity/v3/projects/e9ae5987d1de44528de1dd4b294163e7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:20:58.907085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aee2a-c21f-42ee-8773-604638ad96d5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:58.907825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aee2a-c21f-42ee-8773-604638ad96d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:58.912409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aee2a-c21f-42ee-8773-604638ad96d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:58.967702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ea8aee2a-c21f-42ee-8773-604638ad96d5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:58.969818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ea8aee2a-c21f-42ee-8773-604638ad96d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:59.017348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 834/1669] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:59.034066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.034525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.034943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.082039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:59.086801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:59.134440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 835/1670] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:59.141463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:59.179364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323b40-f74a-4d4d-9b08-95923996dad1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:59.210310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:59.213772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.216794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.217245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.218244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:20:59.218687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:59.223873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:59.283758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 836/1671] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:20:59.288033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:59.288373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 836/1672] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:59.305453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.305732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.306007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.324177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc689ca-2ab8-4a91-b4e2-459edf155192 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:59.343001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:59.344167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.344822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.345831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.350652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:59.359698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:59.409213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:59.427010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:59.439946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 837/1673] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:20:59 2021] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:20:59.445293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:59.538542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416f14-c88e-489b-8fb8-39cccc71c5d2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:59.569314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:59.570257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.570656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.571047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.575368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:59.575368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:59.668540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 838/1674] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:20:59 2021] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:20:59.669373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:59.698363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:59.726394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 837/1675] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:20:59.729948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:20:59.749146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21d561-d369-4ac7-af64-a7dac7f69efa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:59.761785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:59.763846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.764477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.764950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] PATH_INFO: `/v3/users/2a98a4c40dd04561ace2576e8b333657` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.767826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a98a4c40dd04561ace2576e8b333657)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:59.773596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:59.785111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0290-deed-4d46-ab5b-932daf53a68f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:20:59.823900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:20:59.841517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:59.845465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:59.846104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:59.850334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:20:59.858756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:20:59.949218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 838/1676] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:20:59 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:20:59.951189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:00.040584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5eaba-c97b-4380-9252-0eb30a4925a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:00.072266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a98a4c40dd04561ace2576e8b333657'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:00.073084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a98a4c40dd04561ace2576e8b333657'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:00.093259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a98a4c40dd04561ace2576e8b333657'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:00.098885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:00.103765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:00.108715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:00.111913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:00.129892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a98a4c40dd04561ace2576e8b333657'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:00.130753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:00.131359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:00.135329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:00.153314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a98a4c40dd04561ace2576e8b333657'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:00.183967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 839/1677] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:20:59 2021] DELETE /identity/v3/users/2a98a4c40dd04561ace2576e8b333657 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:00.189574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:00.195034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:00.207236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 839/1678] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:20:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:00.212749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:00.239740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:00.296281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e156c-3f2c-42fe-b709-9ad95154fac9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:00.636836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f0a-e686-426d-b9b1-7fa08a7fdd79 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:00.727769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:00.737029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:00.737737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:00.738216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:00.739592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:00.753628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:00.755096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:00.755571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:00.756053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:00.757441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:00.765656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:00.795157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:00.881080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 840/1679] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:00 2021] GET /identity/v3/roles => generated 1420 bytes in 696 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:00.882738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:00.963470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40950b7d-4a45-4e3e-9d5d-7e2bd3c98bd0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:00.993075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 840/1680] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:00 2021] POST /identity/v3/projects => generated 363 bytes in 781 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:00.999615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:01.009744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:01.012979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:01.014660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:01.014660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] PATH_INFO: `/v3/projects/5cd5c73570054fc897c63f1d210ccc67/users/f3a88da139714863954c7564c30d96e3/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:01.074872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5c73570054fc897c63f1d210ccc67, user_id=f3a88da139714863954c7564c30d96e3, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:01.079195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d685e-97d1-4daf-bdd4-767bf82be1ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:01.164471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 841/1681] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:00 2021] PUT /identity/v3/projects/5cd5c73570054fc897c63f1d210ccc67/users/f3a88da139714863954c7564c30d96e3/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:01.298591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:01.302026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:01.302708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:01.398465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] MFA Rules not processed for user `f3a88da139714863954c7564c30d96e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:01.401578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:01.610340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 842/1682] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:01 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:01.617040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:01.709711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dddc31-05da-4cae-99aa-e40ccd6846a4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:01.811031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd403-eb7b-4b19-aa99-34ee0806b35a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:01.826370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:01.827322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:01.827819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:01.828160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:01.831183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:01.837779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:01.927616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 843/1683] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:01 2021] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:01.929784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:02.205317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1b7b-b29c-481a-b763-c10617f92c56 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:02.217962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:02.218682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:02.219000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:02.219220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:02.220326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:02.222127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:02.310793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 844/1684] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:01 2021] POST /identity/v3/users => generated 308 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:02.318445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:02.367573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb57b5-64ef-4b95-a40e-fbef9ecdacfa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:02.406287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:02.406959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:02.407285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:02.407567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:02.408546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:02.410445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:02.481637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 845/1685] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:02.484564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:02.527176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0bad-f025-4800-bd06-365f0c118ea7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:02.547608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:02.549518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:02.549802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:02.550058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] PATH_INFO: `/v3/projects/2cfdf1c9824746319520ba038e00cd9f/users/9a3b7f686eb649a99b3d04d2b70e9c99/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:02.633853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfdf1c9824746319520ba038e00cd9f, user_id=9a3b7f686eb649a99b3d04d2b70e9c99, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:02.639541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:02.730595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 846/1686] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:02 2021] PUT /identity/v3/projects/2cfdf1c9824746319520ba038e00cd9f/users/9a3b7f686eb649a99b3d04d2b70e9c99/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:02.734037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:02.742214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:02.751398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:02.753299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:02.756970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:02.757538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:02.758989 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:02.763635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:02.927042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 841/1687] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:00 2021] POST /identity/v3/users => generated 282 bytes in 1929 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:02.928097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:03.001701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae76c4-0b54-456a-91ee-006789189f46 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.280800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2194f1-8beb-4083-bbaa-9597d0679bc9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.325513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:03.332837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:03.332837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:03.340380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] PATH_INFO: `/v3/users/33aa48b6003442818648eb57b6100ea5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:03.352964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33aa48b6003442818648eb57b6100ea5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:03.366014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:03.443166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:03.444402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:03.452661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:03.453331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:03.454879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:03.458311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:03.536263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 842/1688] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:03.538365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:03.556505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33aa48b6003442818648eb57b6100ea5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.559188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33aa48b6003442818648eb57b6100ea5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.590845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1147-92ba-47d6-bf7b-f4bba49f4368 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.598735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33aa48b6003442818648eb57b6100ea5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.634155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:03.635573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:03.636241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:03.641720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:03.643578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:03.647133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:03.683771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33aa48b6003442818648eb57b6100ea5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.706990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 843/1689] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:03 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:03.725461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:03.729061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:03.730637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33aa48b6003442818648eb57b6100ea5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.765165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 847/1690] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:02 2021] DELETE /identity/v3/users/33aa48b6003442818648eb57b6100ea5 => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:03.766744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:03.775382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810ce08-620f-4fbe-b7a0-1c886b3497dc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.777110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:04.077293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d40a-9197-4a95-8a14-f97de3a320cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:04.091749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:04.097306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.097747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.098175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] PATH_INFO: `/v3/projects/8b5ed861193f4a1a8f0c5814d631c51e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.100285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5ed861193f4a1a8f0c5814d631c51e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:04.103084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:04.127578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:04.129466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.133434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.134120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] PATH_INFO: `/v3/projects/2cfdf1c9824746319520ba038e00cd9f/users/9a3b7f686eb649a99b3d04d2b70e9c99/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.145152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfdf1c9824746319520ba038e00cd9f, user_id=9a3b7f686eb649a99b3d04d2b70e9c99, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:04.153065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:04.207538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 848/1691] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:03 2021] PUT /identity/v3/projects/2cfdf1c9824746319520ba038e00cd9f/users/9a3b7f686eb649a99b3d04d2b70e9c99/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:04.207538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:04.210611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:04.286113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5ed861193f4a1a8f0c5814d631c51e', 'request_id': 'req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:04.337707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5ed861193f4a1a8f0c5814d631c51e', 'request_id': 'req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:04.348392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5ed861193f4a1a8f0c5814d631c51e', 'request_id': 'req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:04.416265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] The token cache is being invalidate because project 8b5ed861193f4a1a8f0c5814d631c51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:04.421166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:04.433396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2abf378b-2cb0-411b-84c6-ea4dea3bccb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:04.439450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 844/1692] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:03 2021] DELETE /identity/v3/projects/8b5ed861193f4a1a8f0c5814d631c51e => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:04.445458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.446909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.447545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.467663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a1ca-2ff8-4607-8d1f-e407fa2e9810 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:04.529822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:04.534133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:04.673604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:04.673604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.674870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.675253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.676194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:04.681193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c575569-678e-4a2b-a7bd-78dd0960eced admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:04.720855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 849/1693] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:04.722650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.724520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.724705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.757968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 845/1694] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:04.759181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:04.764758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:04.825027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb25417-ef5c-4ad2-b712-1bf8b074b739 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:04.832200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] MFA Rules not processed for user `9a3b7f686eb649a99b3d04d2b70e9c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:04.833746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:04.843991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:04.845325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:04.846194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:04.846792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] PATH_INFO: `/v3/users/66b1c910ad7442e1ac0678375e3710c8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:04.851752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b1c910ad7442e1ac0678375e3710c8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:04.858985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:05.040992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b1c910ad7442e1ac0678375e3710c8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.073339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b1c910ad7442e1ac0678375e3710c8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.088860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b1c910ad7442e1ac0678375e3710c8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.100865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b1c910ad7442e1ac0678375e3710c8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.104984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 850/1695] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:04 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:05.106147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:05.106271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b1c910ad7442e1ac0678375e3710c8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.117231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.128401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 846/1696] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:04 2021] DELETE /identity/v3/users/66b1c910ad7442e1ac0678375e3710c8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:05.129943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:05.131754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.145196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65477bb0-75a2-40b7-870c-2685cbcaf0f6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:05.309766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bca5a-6692-4c49-9773-624d15966bdb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:05.323208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:05.324998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:05.325551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:05.326022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] PATH_INFO: `/v3/users/b808c98d10924e52b059963c1cd62752` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:05.328479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b808c98d10924e52b059963c1cd62752)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:05.332532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:05.361161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:05.362262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:05.362620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:05.362937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] PATH_INFO: `/v3/projects/4c1e1537f2e94cb9acb298ccbcc6a6ce/users/bea469e0619c40838b4a605d548a9a73/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:05.412159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1e1537f2e94cb9acb298ccbcc6a6ce, user_id=bea469e0619c40838b4a605d548a9a73, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:05.412159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:05.471864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 851/1697] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:05 2021] PUT /identity/v3/projects/4c1e1537f2e94cb9acb298ccbcc6a6ce/users/bea469e0619c40838b4a605d548a9a73/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:05.475474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:05.487374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.504770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b808c98d10924e52b059963c1cd62752'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.580213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b808c98d10924e52b059963c1cd62752'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.601346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b808c98d10924e52b059963c1cd62752'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.629462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b808c98d10924e52b059963c1cd62752'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.630598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b808c98d10924e52b059963c1cd62752'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:05.640547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 847/1698] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:05 2021] DELETE /identity/v3/users/b808c98d10924e52b059963c1cd62752 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:05.641766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:05.646429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.650166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2a24-b9c6-49b1-b0a9-cbbf284eca4c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:05.784738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:05.785592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:05.785898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:05.786212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:05.798016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.833462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b19f-0e97-4c06-9d38-9bee7c0ac6f8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:05.850919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:05.850919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:05.850919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:05.850919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:05.853786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:05.992022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:05.994032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b49b6f-d943-48fc-8497-b78271d59b32 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:06.060947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 852/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:06.064085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:06.065476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:06.065972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:06.158633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:06.164738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6019d00-33f6-45c9-83fd-d4b041dde377 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:06.212976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 848/1700] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:05 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:06.215957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e324-d992-45ca-a14b-27979aed8aff None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:06.216783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e324-d992-45ca-a14b-27979aed8aff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:06.217395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e324-d992-45ca-a14b-27979aed8aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:06.238141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] MFA Rules not processed for user `bea469e0619c40838b4a605d548a9a73`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:06.256985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.331904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5c30e324-d992-45ca-a14b-27979aed8aff None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:06.339100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5c30e324-d992-45ca-a14b-27979aed8aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.389502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 849/1701] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:06.390632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe93e-f6f1-4eac-8aab-22ac78295708 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:06.390952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe93e-f6f1-4eac-8aab-22ac78295708 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:06.391269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe93e-f6f1-4eac-8aab-22ac78295708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:06.460720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bb8fe93e-f6f1-4eac-8aab-22ac78295708 None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:06.466130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bb8fe93e-f6f1-4eac-8aab-22ac78295708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.482994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 850/1702] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Dec 15 16:21:06 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:06.486190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:06.486966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:06.487678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:06.646183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 853/1703] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:06 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:06.656353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:06.663224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.674418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] MFA Rules not processed for user `17203383b6ed406a959b7a93cf184c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:06.675685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.734787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e0d46-47ef-48c7-aa0b-0958df4c8763 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:06.756845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:06.758769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:06.759140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:06.764411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:06.817671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:06.825805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:06.886134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 854/1704] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:06.890910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:06.895517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:06.965171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584b4b-7b6c-483e-b331-ba5471c8fbb2 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:06.999038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:07.021181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:07.022292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:07.024858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:07.026344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:07.052220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 851/1705] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:06 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:07.053267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:07.054266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:07.054706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:07.119904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efde82-3ddc-4286-aef7-a1a8ffae9246 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:07.142800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:07.145662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:07.157368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:07.158238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] PATH_INFO: `/v3/projects/8978aa60f5f54578bdb5142a523330a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:07.160266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8978aa60f5f54578bdb5142a523330a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:07.167738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:07.169208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 855/1706] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:06 2021] POST /identity/v3/projects => generated 363 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:07.179373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:07.191970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:07.292179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8978aa60f5f54578bdb5142a523330a6', 'request_id': 'req-81783107-13e9-40be-8614-e93b5a85c860'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.309701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8978aa60f5f54578bdb5142a523330a6', 'request_id': 'req-81783107-13e9-40be-8614-e93b5a85c860'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.330299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8978aa60f5f54578bdb5142a523330a6', 'request_id': 'req-81783107-13e9-40be-8614-e93b5a85c860'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.364119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] The token cache is being invalidate because project 8978aa60f5f54578bdb5142a523330a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:07.364410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.365304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.371427 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 852/1707] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:07 2021] DELETE /identity/v3/projects/8978aa60f5f54578bdb5142a523330a6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:07.374864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:07.377802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:07.394138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87c40-5563-4cb2-be79-a9d976f3f4a0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:07.662977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:07.665674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783107-13e9-40be-8614-e93b5a85c860 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:07.668134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:07.668933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:07.671143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:07.676113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:07.678852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:07.679082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:07.679606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:07.680106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] PATH_INFO: `/v3/users/f3a88da139714863954c7564c30d96e3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:07.683029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a88da139714863954c7564c30d96e3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:07.685444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:07.732807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:07.735413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666849f-5349-4396-afa3-7a0be73012d6 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:07.752833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 856/1708] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:07.779844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2b42-d65b-410b-9483-8acdcaacd0ec None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:07.780449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2b42-d65b-410b-9483-8acdcaacd0ec None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:07.781573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2b42-d65b-410b-9483-8acdcaacd0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:07.793220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a88da139714863954c7564c30d96e3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.811565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9f8a2b42-d65b-410b-9483-8acdcaacd0ec None None] MFA Rules not processed for user `17203383b6ed406a959b7a93cf184c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:07.822643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9f8a2b42-d65b-410b-9483-8acdcaacd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:07.833970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a88da139714863954c7564c30d96e3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.853217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a88da139714863954c7564c30d96e3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.872293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a88da139714863954c7564c30d96e3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.877165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a88da139714863954c7564c30d96e3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:07.894459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 853/1709] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:07 2021] DELETE /identity/v3/users/f3a88da139714863954c7564c30d96e3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:07.895981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:07.903459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.096795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 857/1710] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:07 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:08.109503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.113329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.114392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:08.188050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:08.197856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.229458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e41d-d98f-495e-a051-82a44978baec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:08.236132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 858/1711] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:08.260509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:08.265721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.328928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:08.330788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.331173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.331661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:08.342655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64539b8-fcc0-4665-9f46-5fa855bdb314 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:08.343647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:08.354713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:08.356695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edabee-6f33-4da3-b965-3de9d50dbf14 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:08.357053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.357684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.358624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] PATH_INFO: `/v3/projects/ce9b3832783f421ab1f5762ebca1d6f7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:08.360839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9b3832783f421ab1f5762ebca1d6f7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:08.364560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:08.438250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 854/1712] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:07 2021] POST /identity/v3/users => generated 288 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:08.438250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02695-5399-41a6-bd92-3394459084de None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.438250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02695-5399-41a6-bd92-3394459084de None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.438250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02695-5399-41a6-bd92-3394459084de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:08.490598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b8e02695-5399-41a6-bd92-3394459084de None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:08.491754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b8e02695-5399-41a6-bd92-3394459084de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.548874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9b3832783f421ab1f5762ebca1d6f7', 'request_id': 'req-1746a8d4-2717-4486-95bf-69ee6e3c0c25'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.582211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9b3832783f421ab1f5762ebca1d6f7', 'request_id': 'req-1746a8d4-2717-4486-95bf-69ee6e3c0c25'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.608977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9b3832783f421ab1f5762ebca1d6f7', 'request_id': 'req-1746a8d4-2717-4486-95bf-69ee6e3c0c25'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.627574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 855/1713] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:08.629424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02695-5399-41a6-bd92-3394459084de None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:08.635575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b8e02695-5399-41a6-bd92-3394459084de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.678385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] The token cache is being invalidate because project ce9b3832783f421ab1f5762ebca1d6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:08.679288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.679554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.686756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 859/1714] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:08 2021] DELETE /identity/v3/projects/ce9b3832783f421ab1f5762ebca1d6f7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:08.688346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:08.690340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:08.734111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a8d4-2717-4486-95bf-69ee6e3c0c25 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:08.749002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:08.752371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.752873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.753281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] PATH_INFO: `/v3/projects/f53b51bf484d4b4b99e6143a1cbfb524` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:08.758262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53b51bf484d4b4b99e6143a1cbfb524)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:08.762769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:08.851809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02695-5399-41a6-bd92-3394459084de None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:08.901313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53b51bf484d4b4b99e6143a1cbfb524', 'request_id': 'req-984e23e1-62f4-4dd9-a298-7e050689d1bf'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.922403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53b51bf484d4b4b99e6143a1cbfb524', 'request_id': 'req-984e23e1-62f4-4dd9-a298-7e050689d1bf'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.930089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53b51bf484d4b4b99e6143a1cbfb524', 'request_id': 'req-984e23e1-62f4-4dd9-a298-7e050689d1bf'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.968775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] The token cache is being invalidate because project f53b51bf484d4b4b99e6143a1cbfb524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:08.969312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.969971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-984e23e1-62f4-4dd9-a298-7e050689d1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:08.971932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 860/1715] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:08 2021] DELETE /identity/v3/projects/f53b51bf484d4b4b99e6143a1cbfb524 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:08.973312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:08.973613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:08.973895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.021381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:09.022947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.151335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.158195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.158497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.158914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.170031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.188305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 861/1716] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:09.188305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:09.188305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.201863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedd4b9-febe-44e2-8378-6cdc4c054e2e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:09.209807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.209807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.210269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.210269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.211163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.214033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.229096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 862/1717] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:09 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:09.229096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:09.229096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.397694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a3b1-d97c-4d57-90a4-08b327e9abfd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:09.419364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.421221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.422127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.422946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.429398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.431330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.439250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49bce0-c3c2-4f4a-a779-de5d819c12fe service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.490369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 856/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:08 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:09.492326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.495421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.498939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.500080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.500911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.558116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 863/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:09.562881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:09.574968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:09.576384 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.578002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:09.587277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 857/1720] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:09.588194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:09.623045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa9d1-4792-4581-bcd7-a2daf561fb0f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:09.633833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.637178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.637534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.637824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.638617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:09.638929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.640678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.656300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece6ae-183a-44df-a8ec-3984cfb3d555 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:09.668125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 858/1721] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:09.669063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:09.685686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403615a-0b5d-4d54-8397-cd2dfa11ce69 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:09.697290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.698278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.700265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.700708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] PATH_INFO: `/v3/projects/5dafc0bd061444e0a12747a6345afeef/users/d68b3d5682c04b2c8ced11b0bef30f92/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.749864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:09.751551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.752087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.752666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] PATH_INFO: `/v3/users/65131610efdf4d16bf83a679536f3d60` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.766384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65131610efdf4d16bf83a679536f3d60)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.773243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.775762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dafc0bd061444e0a12747a6345afeef, user_id=d68b3d5682c04b2c8ced11b0bef30f92, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:09.795558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300abaee-f1a4-4f04-98b8-f0ad4e2c2745 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:09.865369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 859/1722] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:09 2021] PUT /identity/v3/projects/5dafc0bd061444e0a12747a6345afeef/users/d68b3d5682c04b2c8ced11b0bef30f92/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:09.874925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:09.875404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:09.875905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:09.971849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65131610efdf4d16bf83a679536f3d60'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:09.979798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65131610efdf4d16bf83a679536f3d60'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:09.990141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:09.992955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:10.046150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65131610efdf4d16bf83a679536f3d60'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:10.136811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65131610efdf4d16bf83a679536f3d60'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:10.170183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 860/1723] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:10.171248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:10.172907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65131610efdf4d16bf83a679536f3d60'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:10.195126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfada0-e41a-463b-97ad-3f20f55f7d61 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:10.214820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 864/1724] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:09 2021] DELETE /identity/v3/users/65131610efdf4d16bf83a679536f3d60 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:10.218363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:10.219777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:10.219983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:10.220630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:10.220918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:10.221775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:10.223968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:10.230759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:10.363634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 861/1725] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:10 2021] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:10.365296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:10.381328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:10.668214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d4ec-085d-4514-9537-870c6e02a259 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:10.744164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a42e-5299-4390-ba11-4ae3e54218d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:10.757226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:10.758681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:10.759668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:10.760250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:10.761822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:10.762369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:10.767555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:10.820398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 862/1726] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:10.828962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:10.836787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:10.873049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:10.874849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:10.879509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:10.881446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:10.888074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:10.900676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:10.901036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c84e4-d093-4ff4-b5fc-12cb275eaa35 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:10.941076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:10.942355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:10.942699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 865/1727] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:10 2021] GET /identity/v3/roles => generated 1420 bytes in 727 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:10.945741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:10.950929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:10.953239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:10.961098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:10.963340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:10.966351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:10.994728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108878-414b-4537-8ae1-5bbf9618e8a2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:11.027229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:11.028203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:11.033187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:11.034297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] PATH_INFO: `/v3/projects/5cd5c73570054fc897c63f1d210ccc67` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:11.037414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd5c73570054fc897c63f1d210ccc67)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:11.048495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:11.132391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 863/1728] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:10 2021] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:11.134451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:11.198768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aa795-bee0-4ba0-86d5-3436b1779f97 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:11.218881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd5c73570054fc897c63f1d210ccc67', 'request_id': 'req-9bfa5980-987e-4fc7-ba8e-848ce9fac035'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:11.238589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd5c73570054fc897c63f1d210ccc67', 'request_id': 'req-9bfa5980-987e-4fc7-ba8e-848ce9fac035'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:11.259592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd5c73570054fc897c63f1d210ccc67', 'request_id': 'req-9bfa5980-987e-4fc7-ba8e-848ce9fac035'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:11.298483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] The token cache is being invalidate because project 5cd5c73570054fc897c63f1d210ccc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:11.299666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:11.301689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:11.315058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 866/1729] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:10 2021] DELETE /identity/v3/projects/5cd5c73570054fc897c63f1d210ccc67 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:11.315058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:11.318764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:11.568956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5980-987e-4fc7-ba8e-848ce9fac035 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:11.583679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:11.586946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:11.588773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:11.589901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] PATH_INFO: `/v3/projects/5dafc0bd061444e0a12747a6345afeef/users/d68b3d5682c04b2c8ced11b0bef30f92/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:11.596029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dafc0bd061444e0a12747a6345afeef, user_id=d68b3d5682c04b2c8ced11b0bef30f92, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:11.601729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:11.603266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:11.603793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:11.604287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:11.606601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:11.616277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:11.620493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:11.649343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 867/1730] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:11 2021] PUT /identity/v3/projects/5dafc0bd061444e0a12747a6345afeef/users/d68b3d5682c04b2c8ced11b0bef30f92/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:11.652473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:11.657684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:11.837678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 864/1731] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:11 2021] POST /identity/v3/projects => generated 379 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:11.839551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:11.845689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:11.982988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef86d-9fc0-4015-b696-1a0b4fc0deec admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:12.074991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b17f8-767b-4cf7-8ccf-7df1c1cde85e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:12.106759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:12.108547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:12.109304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:12.109882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] PATH_INFO: `/v3/users/9a3b7f686eb649a99b3d04d2b70e9c99` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:12.117273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3b7f686eb649a99b3d04d2b70e9c99)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:12.124530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:12.215199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:12.220901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:12.223185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:12.223491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:12.226304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:12.234144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab548b-ff2b-4166-b10c-3e011611acea admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:12.261775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 868/1732] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:11 2021] GET /identity/v3/roles => generated 1420 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:12.263800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5f0d-451f-49e8-ba6e-2d871dcda46b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:12.268251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5f0d-451f-49e8-ba6e-2d871dcda46b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:12.269024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5f0d-451f-49e8-ba6e-2d871dcda46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:12.321738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3b7f686eb649a99b3d04d2b70e9c99'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:12.352963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-83aa5f0d-451f-49e8-ba6e-2d871dcda46b None None] MFA Rules not processed for user `d68b3d5682c04b2c8ced11b0bef30f92`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:12.356309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-83aa5f0d-451f-49e8-ba6e-2d871dcda46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:12.368782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3b7f686eb649a99b3d04d2b70e9c99'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:12.393583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3b7f686eb649a99b3d04d2b70e9c99'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:12.433479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3b7f686eb649a99b3d04d2b70e9c99'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:12.435589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3b7f686eb649a99b3d04d2b70e9c99'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:12.463494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 865/1733] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:11 2021] DELETE /identity/v3/users/9a3b7f686eb649a99b3d04d2b70e9c99 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:12.481848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:12.484228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:12.682047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 869/1734] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:12 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:12.687881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:12.688166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:12.691884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:12.768893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] MFA Rules not processed for user `b7f047bf1080497290a18bff8b4e4337`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:12.770936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:12.893716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a1cb-efce-4f91-919f-07178fddf97d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:12.935221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:12.936208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:12.936613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:12.937070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] PATH_INFO: `/v3/projects/9b53f668271f413195eeef4e82a1fb41` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:12.941962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b53f668271f413195eeef4e82a1fb41)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:12.945859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:13.028742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 870/1735] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:12 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:13.029704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:13.031872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.071160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5207b-589c-4e95-83bd-7d356447f39c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:13.105255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:13.106027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.106316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.106600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.114584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:13.118989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:13.157047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b53f668271f413195eeef4e82a1fb41', 'request_id': 'req-4a791e2f-166d-4b74-907b-82369cc1b312'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:13.191240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b53f668271f413195eeef4e82a1fb41', 'request_id': 'req-4a791e2f-166d-4b74-907b-82369cc1b312'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:13.212511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 871/1736] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:13 2021] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:13.212511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:13.217235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.232018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b53f668271f413195eeef4e82a1fb41', 'request_id': 'req-4a791e2f-166d-4b74-907b-82369cc1b312'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:13.266461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c56b-46c6-45d8-9c58-6bb25e0eb1fb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:13.310664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] The token cache is being invalidate because project 9b53f668271f413195eeef4e82a1fb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:13.314564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:13.327486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:13.335728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 866/1737] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:12 2021] DELETE /identity/v3/projects/9b53f668271f413195eeef4e82a1fb41 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:13.340881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:13.348803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.583523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791e2f-166d-4b74-907b-82369cc1b312 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:13.588397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:13.589648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.591395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:13.592789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.593275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.593844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.598341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.603854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.604583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.606019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:13.630053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:13.714215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 872/1738] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:13 2021] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:13.716691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:13.733324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.820092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:13.821980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:13.835626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42008c7-218e-4431-ba62-5b398029e6f5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:13.867265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:13.869239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.870316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.871121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.873856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:13.877669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847cce-76d2-4732-9f89-e1005b38f1d0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:13.881113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 867/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:13 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:13.881993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:13.890696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:13.922276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 873/1740] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:13 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:13.928127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a199-dd2a-4527-8af7-f33a9721b7e1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.929713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a199-dd2a-4527-8af7-f33a9721b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.931880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a199-dd2a-4527-8af7-f33a9721b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.939064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada16-a3e0-4ff6-9d15-58b839e36bf0 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:13.959994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:13.961041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:13.963559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:13.967259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] PATH_INFO: `/v3/projects/2cfdf1c9824746319520ba038e00cd9f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:13.969428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfdf1c9824746319520ba038e00cd9f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:13.988828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:14.037280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5ca5a199-dd2a-4527-8af7-f33a9721b7e1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:14.043477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5ca5a199-dd2a-4527-8af7-f33a9721b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.071636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 874/1741] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:14.074577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.075198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.077067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.090989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 875/1742] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:21:14 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:21:14.093224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:14.101740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.153906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfdf1c9824746319520ba038e00cd9f', 'request_id': 'req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.183799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfdf1c9824746319520ba038e00cd9f', 'request_id': 'req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.196693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfdf1c9824746319520ba038e00cd9f', 'request_id': 'req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.226919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] The token cache is being invalidate because project 2cfdf1c9824746319520ba038e00cd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:14.227885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.228866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.231266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 868/1743] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:13 2021] DELETE /identity/v3/projects/2cfdf1c9824746319520ba038e00cd9f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:14.232624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:14.234412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.328124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f35fa-5738-482d-9de4-840b7b4e14b1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:14.334958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:14.338824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.338824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.338824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] PATH_INFO: `/v3/projects/a7500edb10a243139c0674f4f8686f48/users/d973cd865b0c4783a8168ecfdf108917/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.377462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7500edb10a243139c0674f4f8686f48, user_id=d973cd865b0c4783a8168ecfdf108917, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:14.381399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa7909-3949-4109-9266-a4c8125cf3a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:14.422441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1b9a-03a0-41b2-a733-d7e119f19cb9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:14.425032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 876/1744] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:14 2021] PUT /identity/v3/projects/a7500edb10a243139c0674f4f8686f48/users/d973cd865b0c4783a8168ecfdf108917/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:14.426972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1677-b271-4e56-8e1a-1d6d326f1a7f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.427269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1677-b271-4e56-8e1a-1d6d326f1a7f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.427556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1677-b271-4e56-8e1a-1d6d326f1a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.468870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fc2e1677-b271-4e56-8e1a-1d6d326f1a7f None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:14.473138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fc2e1677-b271-4e56-8e1a-1d6d326f1a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.549313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:14.550261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.550438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.550690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.551508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:14.556102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f9259-f44d-4e1f-9cd7-6dda97c7cdca admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:14.582958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 869/1745] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:14 2021] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:14.584820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b214f-6f63-47ec-b458-02b48a03b88f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.585309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b214f-6f63-47ec-b458-02b48a03b88f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.586066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b214f-6f63-47ec-b458-02b48a03b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.614230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-369b214f-6f63-47ec-b458-02b48a03b88f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:14.616162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-369b214f-6f63-47ec-b458-02b48a03b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.628371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 870/1746] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:14.630328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.630819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.631276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.656215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:14.658188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.668950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 871/1747] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:14.670222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:14.671946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.704590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 877/1748] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:21:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:14.707398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.710867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc6e69-b804-42fb-aa6e-4430c7af91e0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:14.713419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.715281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.724763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:14.725723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:14.726008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:14.727002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] PATH_INFO: `/v3/users/bea469e0619c40838b4a605d548a9a73` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:14.732008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea469e0619c40838b4a605d548a9a73)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:14.734056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:14.776222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] MFA Rules not processed for user `d973cd865b0c4783a8168ecfdf108917`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:14.779549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:14.880076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea469e0619c40838b4a605d548a9a73'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.907669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea469e0619c40838b4a605d548a9a73'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.931607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea469e0619c40838b4a605d548a9a73'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.950658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea469e0619c40838b4a605d548a9a73'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.956872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea469e0619c40838b4a605d548a9a73'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:14.980553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 872/1749] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:14 2021] DELETE /identity/v3/users/bea469e0619c40838b4a605d548a9a73 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:14.982016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:14.985966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.059003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 878/1750] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:15.059614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:15.062548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.110553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe83151-d994-40ed-9408-a7af219d4dc6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:15.154710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e949c-05b5-4fb0-a5ac-5bcb4a4af054 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:15.161404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:15.162891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.163396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.164083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] PATH_INFO: `/v3/projects/2a93b6cad6fd4b5d94730c6383245124/users/17b3b1e10601400d8cffd33ee674c66b/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.193501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a93b6cad6fd4b5d94730c6383245124, user_id=17b3b1e10601400d8cffd33ee674c66b, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:15.212419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661c98f-ed40-4d0f-924a-0a0e745b2fba admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:15.267536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 873/1751] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:14 2021] PUT /identity/v3/projects/2a93b6cad6fd4b5d94730c6383245124/users/17b3b1e10601400d8cffd33ee674c66b/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:15.270886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.271375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.271919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.318707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:15.319441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.331704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.332156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.333074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:15.333399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:15.335189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631b17-e381-4eb8-9f61-a8b1d983f9c4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:15.354872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:15.355164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 879/1752] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:15.357324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.357708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.358243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.364868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.382433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:15.384701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.509936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 874/1753] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:15.511428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:15.513215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.528604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 880/1754] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:15.530439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5747-da89-412c-9b1a-6afe0ca57e06 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:15.530803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:15.534886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.545983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:15.547037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.547622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.547971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.549416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:15.552298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ae14f-771f-41fb-a12c-9edd7611a94c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:15.605222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 875/1755] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:15.607990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf5d8-bd9a-440e-8635-41a5d74b963b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.608753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf5d8-bd9a-440e-8635-41a5d74b963b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.609777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf5d8-bd9a-440e-8635-41a5d74b963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.635286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-425cf5d8-bd9a-440e-8635-41a5d74b963b None None] MFA Rules not processed for user `17203383b6ed406a959b7a93cf184c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:15.637687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-425cf5d8-bd9a-440e-8635-41a5d74b963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.682190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86690b81-77d9-4b35-ba56-302ffcfaa164 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:15.764942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 876/1756] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:15.767721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.767986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.768263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.810790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] MFA Rules not processed for user `17b3b1e10601400d8cffd33ee674c66b`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:15.813115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.828892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:15.830939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:15.831492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:15.832179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:15.835568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:15.854533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:15.857566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:15.875961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 881/1757] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:15.879322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:15.972767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 877/1758] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:15.972767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:15.999455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de83-54b8-4ee8-9f19-fb9f9367fdeb service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.006375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.008105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.008642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.009292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.010236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.012793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.061090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 882/1759] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:15 2021] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.064819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.067780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:16.079057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4c97-12cb-4fb8-83d6-38ebdad3c4df None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.167783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96065-6769-4701-9e3a-613952b9e8c0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.172590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.173219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.173723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.174059 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.179353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.180332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.181395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.181850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.182918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:16.183048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.185677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.202007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 878/1760] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:16.202007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.219037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3b6f-3426-4c7a-a3f9-aefde9fbcdfa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.226640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.227351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.228127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.228413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.229186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.231161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.263291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.265039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.266294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 879/1761] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.268352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.278468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 883/1762] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:16.279937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.300658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdfb65-d25f-46be-9035-c3e4232d47d7 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.307137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.307470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d12e-5bdb-4be5-ba22-78d59a6979b9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.308139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.308424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.308771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.309755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.311909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.339071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.340259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.344317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.345950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.349471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.353305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 884/1763] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/users => generated 282 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.359283 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.361138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.386798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4c116-a103-4971-a57a-5762793ccec0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.395496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.395496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.395496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.396398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.397669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.400872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.452299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 880/1764] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.455059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.460546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 885/1765] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.467990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.646088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe974cd-de0f-4e61-8862-4a3a4ea21a73 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.660841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49301-b495-40ea-934a-b8e3cabc5483 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.679868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.685257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.687172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.688027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.694636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.697086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.699974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.700998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.701295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.701816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.703295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.707139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.738966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 881/1766] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:16.738966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.748165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 886/1767] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:16.759132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a80e36-7d5c-4143-a494-080c0f19fdd6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.762200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.768107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.769377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.769849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.770290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.771589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.776610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.817395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a947-87a8-4d82-b980-b6355cccd77a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.836509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.837262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.837546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.837892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.842537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.849135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.859296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 882/1768] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.859296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.901055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5738c-a4ed-4434-87b0-80f736042d64 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.913661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 887/1769] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:16 2021] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:16.913661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.914081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.914081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.914081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.914081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] PATH_INFO: `/v3/projects/8c841cb35d19419daee0151012bbf57d/users/e2fbc0e47a984ab38c5ff1efd30e6b0f/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.921932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301f8d7-10c7-40f3-b649-6d57cd20a8d4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.927487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:16.928203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:16.928520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:16.928795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:16.929672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.931385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.952283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 888/1770] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:16.952283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:16.952708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c841cb35d19419daee0151012bbf57d, user_id=e2fbc0e47a984ab38c5ff1efd30e6b0f, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:16.958263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:16.968046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59ce9-5f16-49bc-af9c-d2cc18370979 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:16.981074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 883/1771] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:16 2021] PUT /identity/v3/projects/8c841cb35d19419daee0151012bbf57d/users/e2fbc0e47a984ab38c5ff1efd30e6b0f/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:16.982529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.082618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b09c9-56e4-4998-95c9-d3e3aee0e47d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.089570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.092844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.093414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.093588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.094765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.098929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.109645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.110540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.110768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.111230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.111782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.113513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.121125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 884/1772] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:17.121125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.142504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 889/1773] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:17.144127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.151917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3b63-9a99-4be5-9b91-afbee17a2144 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.165890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23e02-f97c-4291-be08-0ecc8474dd8f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.166328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.168303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.169239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.170924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] PATH_INFO: `/v3/projects/9928910518854a80a532b31719f199d8/users/ee04ec2251374dec94648dc81ab867ef/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.178523 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.179305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.179581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.179891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.180663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.182540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.226860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9928910518854a80a532b31719f199d8, user_id=ee04ec2251374dec94648dc81ab867ef, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.233211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.238410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 890/1774] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:17 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:17.239490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.256521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd9d0-f2e5-46e6-a254-6cb7eb272f0f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.265055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.265823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.266160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.266495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.267465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.269295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62455f-4814-4352-b988-fa94e2f705fb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.282602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 885/1775] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:17 2021] PUT /identity/v3/projects/9928910518854a80a532b31719f199d8/users/ee04ec2251374dec94648dc81ab867ef/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:17.287183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 891/1776] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:17 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:17.289285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3e19-3fd4-4c1b-8506-c3c9eb9d609b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.289583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3e19-3fd4-4c1b-8506-c3c9eb9d609b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.289863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3e19-3fd4-4c1b-8506-c3c9eb9d609b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.293068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 892/1777] 10.222.0.30 () {54 vars in 912 bytes} [Wed Dec 15 16:21:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:21:17.294176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3e19-3fd4-4c1b-8506-c3c9eb9d609b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.304155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.431983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3e19-3fd4-4c1b-8506-c3c9eb9d609b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.437269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.438153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.438437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.438709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] PATH_INFO: `/v3/projects/8c841cb35d19419daee0151012bbf57d/users/e2fbc0e47a984ab38c5ff1efd30e6b0f/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.441558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c841cb35d19419daee0151012bbf57d, user_id=e2fbc0e47a984ab38c5ff1efd30e6b0f, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.444468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.481250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 893/1778] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:17 2021] PUT /identity/v3/projects/8c841cb35d19419daee0151012bbf57d/users/e2fbc0e47a984ab38c5ff1efd30e6b0f/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:17.483346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:17.484330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7a74e-baa8-46d6-ad5b-00c266d8456f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.636472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.636472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.636472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.636472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] PATH_INFO: `/v3/projects/df1cb577fb0640ea82fdb913504b2dbb/users/1bde8a3058bc4e9293f75bfcf8de81cb/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.659018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1cb577fb0640ea82fdb913504b2dbb, user_id=1bde8a3058bc4e9293f75bfcf8de81cb, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.663175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b802bc-585a-46da-8f55-57b575a5f5e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.691310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 886/1779] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:17 2021] PUT /identity/v3/projects/df1cb577fb0640ea82fdb913504b2dbb/users/1bde8a3058bc4e9293f75bfcf8de81cb/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:17.693921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebfc93-5531-46a6-ac48-6e7a3ede86d5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.694290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebfc93-5531-46a6-ac48-6e7a3ede86d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.694523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebfc93-5531-46a6-ac48-6e7a3ede86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.697495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9fbf9-9e04-444f-8007-c05b9a11261e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:17.727194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-95ebfc93-5531-46a6-ac48-6e7a3ede86d5 None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:17.736716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-95ebfc93-5531-46a6-ac48-6e7a3ede86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:17.812731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:17.814615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.815309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.815894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] PATH_INFO: `/v3/projects/cab00bede9ad45759c69504666a78b57/users/59b725013f714d6bb65821e5a2de3585/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.841492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab00bede9ad45759c69504666a78b57, user_id=59b725013f714d6bb65821e5a2de3585, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:17.844709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a67abc-a15b-42b8-924b-71924e8d668c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:17.853409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 887/1780] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:21:17 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:17.857367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.857869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.858360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.877026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 894/1781] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:17 2021] PUT /identity/v3/projects/cab00bede9ad45759c69504666a78b57/users/59b725013f714d6bb65821e5a2de3585/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:17.880025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:17.882097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:17.882758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:17.951932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] MFA Rules not processed for user `e2fbc0e47a984ab38c5ff1efd30e6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:17.952164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] MFA Rules not processed for user `ee04ec2251374dec94648dc81ab867ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:17.953606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:17.954511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:18.070711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 888/1782] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:17 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:18.074370 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.092040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 895/1783] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:17 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:18.098793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.100526 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:18.200869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbb13-46a0-4b4c-a86a-c2bdb553c595 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.204243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944e4be-f045-46ef-9bf3-206fc2970ac4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.210800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:18.211197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:18.211946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.212451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.212947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.213300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.213553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.213830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.215059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:18.217241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45704a1c-7341-4b11-b7e4-628c47d4ebe3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:18.229248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:18.235980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:18.236246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 889/1784] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:18 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:18.236246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.236246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.236246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.251017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 896/1785] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:18.252851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.274710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c28e-a156-4199-b2dd-ff2e2328e903 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.283454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:18.284913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.285457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.286014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.287770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:18.292241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:18.314057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] MFA Rules not processed for user `59b725013f714d6bb65821e5a2de3585`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:18.316079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:18.356963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 897/1786] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:18 2021] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:18.358395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.369813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:18.509310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939a0a-0e16-483e-8288-ad58841729c8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.516243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:18.517352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.518045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.518461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.570433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 890/1787] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:18.572385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.575419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:18.617226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22dbc-555e-403b-801f-43e4d0415ffe None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.619553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:18.675695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:18.727545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 898/1788] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:18 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:18.730651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:18.803291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:18.805119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:18.805661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:18.806142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] PATH_INFO: `/v3/projects/4c1e1537f2e94cb9acb298ccbcc6a6ce` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:18.809869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1e1537f2e94cb9acb298ccbcc6a6ce)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:18.813887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:18.950371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562146-a7d4-489d-95cd-63716fb86b6d service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:18.970487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1e1537f2e94cb9acb298ccbcc6a6ce', 'request_id': 'req-5e07df15-8dc4-4bfb-8c53-f4e27785f687'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.008912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1e1537f2e94cb9acb298ccbcc6a6ce', 'request_id': 'req-5e07df15-8dc4-4bfb-8c53-f4e27785f687'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.028582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1e1537f2e94cb9acb298ccbcc6a6ce', 'request_id': 'req-5e07df15-8dc4-4bfb-8c53-f4e27785f687'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.073993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] The token cache is being invalidate because project 4c1e1537f2e94cb9acb298ccbcc6a6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:19.077502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.078855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.081763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 891/1789] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:18 2021] DELETE /identity/v3/projects/4c1e1537f2e94cb9acb298ccbcc6a6ce => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:19.083146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:19.085447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:19.184419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:19.186010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.186913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.187640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] PATH_INFO: `/v3/projects/df1cb577fb0640ea82fdb913504b2dbb/users/1bde8a3058bc4e9293f75bfcf8de81cb/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.197198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1cb577fb0640ea82fdb913504b2dbb, user_id=1bde8a3058bc4e9293f75bfcf8de81cb, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:19.200865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:19.218347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07df15-8dc4-4bfb-8c53-f4e27785f687 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:19.231790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 899/1790] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:18 2021] PUT /identity/v3/projects/df1cb577fb0640ea82fdb913504b2dbb/users/1bde8a3058bc4e9293f75bfcf8de81cb/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:19.232579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:19.235508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:19.357341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:19.358121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.358424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.358702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.359718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:19.367349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:19.384280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8009758-579c-4bfa-b24d-caa342634031 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:19.391153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:19.391780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.392094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.392407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.394207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:19.396996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:19.416726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 892/1791] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:19 2021] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:19.416726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:19.417793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:19.452346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 900/1792] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:19 2021] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:19.458233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:19.472212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:19.513987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47504e3-3160-42d5-ad43-0461a025e749 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:19.564786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664353e-eef8-4e6c-9e17-818eece5edda admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:19.572109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:19.574763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.575054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.575337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] PATH_INFO: `/v3/users/d68b3d5682c04b2c8ced11b0bef30f92` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.577767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68b3d5682c04b2c8ced11b0bef30f92)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:19.580047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:19.587034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:19.587792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.588181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.588541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.590761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:19.678484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68b3d5682c04b2c8ced11b0bef30f92'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.680502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68b3d5682c04b2c8ced11b0bef30f92'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.699263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68b3d5682c04b2c8ced11b0bef30f92'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.737318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68b3d5682c04b2c8ced11b0bef30f92'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.759224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:19.761243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8315fda3-bcdd-44ee-9710-735e937f9311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68b3d5682c04b2c8ced11b0bef30f92'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:19.764504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:19.782987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 901/1793] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:19 2021] DELETE /identity/v3/users/d68b3d5682c04b2c8ced11b0bef30f92 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:19.786403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:19.786893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:19.787017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 893/1794] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:19.787508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:19.789091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:19.812481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423d35-a8c4-4219-a6df-1d64c1b84a4b service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:19.842858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] MFA Rules not processed for user `1bde8a3058bc4e9293f75bfcf8de81cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:19.845474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:20.075756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.078156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.083594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.084482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.086310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.092232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.159289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 894/1795] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:19 2021] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:20.159289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.170621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:20.224637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 902/1796] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:19 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:20.225790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.228051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:20.256937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa916d-11a8-4c5d-b5be-0bbc9e4ffad8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.270072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.280502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e5a4-173c-453e-9102-8ac65d8808b9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.280741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.291983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.292595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] PATH_INFO: `/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c/users/b69ef1a9021f4cd4a889c22a6488f30a/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.304940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.306120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.308168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.310279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.311310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.315204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.364710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3218a8d9cb0e4861ae85926da5a99c5c, user_id=b69ef1a9021f4cd4a889c22a6488f30a, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.368076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 895/1797] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:20 2021] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:20.369590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.377307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:20.378195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.423621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899026f9-7822-4918-a77a-4f47f7a4fb1a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.432790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 903/1798] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:20 2021] PUT /identity/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c/users/b69ef1a9021f4cd4a889c22a6488f30a/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:20.436134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.626565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.629891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3b736-6fbf-4884-a474-a7f188a9b384 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.631861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.632081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.632403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] PATH_INFO: `/v3/users/17b3b1e10601400d8cffd33ee674c66b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.634450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b3b1e10601400d8cffd33ee674c66b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.636487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.642300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.643349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.643633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.643910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.644710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.646388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.670738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 904/1799] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:20.671677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.694529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8139f37-1fb9-4758-bc08-afedacaff1d8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.705530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.712354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.712665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.712931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.713713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.715408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.735770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b3b1e10601400d8cffd33ee674c66b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:20.743589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 905/1800] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:20.745736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.758689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b3b1e10601400d8cffd33ee674c66b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:20.768710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f86b-e2f4-4da9-9362-6296f04ab974 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:20.773622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b3b1e10601400d8cffd33ee674c66b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:20.774673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:20.775696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:20.775982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:20.776264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] PATH_INFO: `/v3/projects/b0a971fa52364d78917034acdb3c05ae/users/68ee5b8d73774ca889e5f5561cc202ba/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:20.805055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b3b1e10601400d8cffd33ee674c66b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:20.807104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b3b1e10601400d8cffd33ee674c66b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:20.809468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a971fa52364d78917034acdb3c05ae, user_id=68ee5b8d73774ca889e5f5561cc202ba, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:20.814913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:20.862775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 906/1802] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:20 2021] PUT /identity/v3/projects/b0a971fa52364d78917034acdb3c05ae/users/68ee5b8d73774ca889e5f5561cc202ba/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:20.864290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.867946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:20.868523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 896/1801] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:20 2021] DELETE /identity/v3/users/17b3b1e10601400d8cffd33ee674c66b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:20.870493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:20.873149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.044069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5551ad-e500-4916-90aa-cdbe64e9aba8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:21.101181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b510-71fb-4905-b0a4-df9a15edbb3f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:21.120720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:21.121923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.123350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.123855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.125369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:21.128750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017ce8-1991-4a00-b060-12a41d510904 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:21.177016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 897/1803] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:20 2021] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:21.182108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c90dd-cbbc-4a69-8ff6-2889a0cc2414 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.183478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c90dd-cbbc-4a69-8ff6-2889a0cc2414 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.186177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c90dd-cbbc-4a69-8ff6-2889a0cc2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.217020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:21.218787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.225566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.226253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] PATH_INFO: `/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c/users/b69ef1a9021f4cd4a889c22a6488f30a/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.235766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8d2c90dd-cbbc-4a69-8ff6-2889a0cc2414 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:21.237721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8d2c90dd-cbbc-4a69-8ff6-2889a0cc2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.254829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3218a8d9cb0e4861ae85926da5a99c5c, user_id=b69ef1a9021f4cd4a889c22a6488f30a, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:21.254829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b9d1c-79a6-4e66-b2be-559a1ac30f43 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:21.289334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 898/1804] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:21.292335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b04-2378-4be6-af0b-b9a6c70969d2 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.293061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b04-2378-4be6-af0b-b9a6c70969d2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.293502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b04-2378-4be6-af0b-b9a6c70969d2 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.296209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 899/1805] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:21:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:21:21.297571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e47b04-2378-4be6-af0b-b9a6c70969d2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:21.298898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 907/1806] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:20 2021] PUT /identity/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c/users/b69ef1a9021f4cd4a889c22a6488f30a/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:21.311067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.311563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.312064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.421657 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] MFA Rules not processed for user `b69ef1a9021f4cd4a889c22a6488f30a`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:21.425034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.434578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e47b04-2378-4be6-af0b-b9a6c70969d2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:21.441671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:21.444940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.445684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.446673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] PATH_INFO: `/v3/projects/b0a971fa52364d78917034acdb3c05ae/users/68ee5b8d73774ca889e5f5561cc202ba/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.451276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a971fa52364d78917034acdb3c05ae, user_id=68ee5b8d73774ca889e5f5561cc202ba, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:21.455913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e9fa0-98fa-473d-baf4-989dde07a48e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:21.506388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 900/1807] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:21 2021] PUT /identity/v3/projects/b0a971fa52364d78917034acdb3c05ae/users/68ee5b8d73774ca889e5f5561cc202ba/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:21.509345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86191-c510-4a12-a46d-6001dff261d5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.511236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86191-c510-4a12-a46d-6001dff261d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.511713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86191-c510-4a12-a46d-6001dff261d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.598933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-29f86191-c510-4a12-a46d-6001dff261d5 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:21.600266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-29f86191-c510-4a12-a46d-6001dff261d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.716119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 908/1808] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:21 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:21.717879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:21.722667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.771064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 901/1809] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:21:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:21.774485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:21.774891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:21.775182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:21.850901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] MFA Rules not processed for user `68ee5b8d73774ca889e5f5561cc202ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:21.852342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:21.965539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e22c3-b457-4e01-9dd9-d6de380b75bc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:22.152390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 902/1810] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:21 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:22.153747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:22.155894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.161667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:22.162502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.162790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.163153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.324914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3343-a700-4237-83fb-4e74e04153cd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:22.335566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:22.336251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.336591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.336868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.337629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:22.339220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:22.363510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 909/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:22.364467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:22.367980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.398519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f84ee-8057-405d-b999-4f8324e3dbe6 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:22.415399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:22.418068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.418387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.419322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] PATH_INFO: `/v3/projects/5dafc0bd061444e0a12747a6345afeef` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.421743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dafc0bd061444e0a12747a6345afeef)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:22.425148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:22.499452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:22.504672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:22.533509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 903/1812] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:22 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:22.535537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:22.538291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.547823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dafc0bd061444e0a12747a6345afeef', 'request_id': 'req-ef67b2f6-29a9-411f-be78-eb52d35482ab'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:22.559609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dafc0bd061444e0a12747a6345afeef', 'request_id': 'req-ef67b2f6-29a9-411f-be78-eb52d35482ab'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:22.569357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dafc0bd061444e0a12747a6345afeef', 'request_id': 'req-ef67b2f6-29a9-411f-be78-eb52d35482ab'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:22.576194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab5f6-1746-4fca-b4b4-0bcaf29ceaf3 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:22.587301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] The token cache is being invalidate because project 5dafc0bd061444e0a12747a6345afeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:22.587666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:22.588869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:22.592966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 910/1813] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:22 2021] DELETE /identity/v3/projects/5dafc0bd061444e0a12747a6345afeef => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:22.593974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:22.595696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.729148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:22.730045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.730422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.730795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.734159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.749835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:22.752853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6714-9a8c-4516-8d35-3944388292b6 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:22.772349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 904/1814] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:22.774719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.775244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.776588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.795758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b2f6-29a9-411f-be78-eb52d35482ab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:22.807366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:22.809372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:22.809988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:22.810458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:22.814680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.815687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:22.818094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:22.962748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:22.966168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1687e8-ca07-4f1f-b22c-c3ddb8db62f2 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:22.976772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 905/1815] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:22.979115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:22.991646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:23.041761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f42399-6bd5-40e3-86f7-464f73b5245c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.059067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 911/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:22 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:23.059621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.060330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.060654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.060936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.064246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1ecb-46e8-466d-98a1-9bd8855bcf8d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.065963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1ecb-46e8-466d-98a1-9bd8855bcf8d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.066612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1ecb-46e8-466d-98a1-9bd8855bcf8d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.072109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:23.073370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 912/1817] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:21:23 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:21:23.077091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af49f-3fb7-481b-b041-562868729195 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.078458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af49f-3fb7-481b-b041-562868729195 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.078947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af49f-3fb7-481b-b041-562868729195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.114283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f03af49f-3fb7-481b-b041-562868729195 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:23.116920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f03af49f-3fb7-481b-b041-562868729195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:23.130734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 913/1818] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:23.136191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.136679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.136972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.161392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:23.162676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:23.183894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 914/1819] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:21:23 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:23.183894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.200245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e671-414a-4696-bbe2-96393436d5a3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.207483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.208556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.209493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.209493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.211041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:23.211548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.213514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.244997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 915/1820] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:23.244997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.245300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:23.275379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e127bd-526d-4add-baa0-45bd94fcfccf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.293650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.294350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.294640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.294953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.308819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.310999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.342329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.348237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.352350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 916/1821] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:23 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:23.353677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.377138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db6bf-c906-44bf-ab98-a88f5f7240ce service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.385008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 906/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:22 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:23.416680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.422929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.424947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.425655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.429137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.431990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.511029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 917/1823] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:23 2021] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:23.514624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.538098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e58d0-54aa-4fb1-b266-52429075ba32 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.713995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.714723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.715009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.715315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.718696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.725043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.791733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 907/1824] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:23 2021] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:23.799642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.827045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd3b97-c283-4927-941b-92f0a485a6d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.843154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.846964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.850797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.851443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.853203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.859402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.895552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 918/1825] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:23 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:23.897517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.926849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8a46-698c-40b6-ac98-359540bd31db admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:23.943676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:23.944821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:23.945360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:23.946258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:23.949501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:23.951574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:23.986255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:23.988688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 908/1826] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:23 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:24.028990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7fe23-8767-4fc2-8048-28f33dd1e36f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:24.039679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:24.040954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:24.041362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:24.041736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] PATH_INFO: `/v3/projects/5b678a76bd0642ba90455880a682c23d/users/37787146e3c648b2af83a15ab2e7c8f9/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:24.078816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b678a76bd0642ba90455880a682c23d, user_id=37787146e3c648b2af83a15ab2e7c8f9, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:24.083579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27219e-351d-47c5-9fc2-f319482e1e64 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:24.098063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:24.165512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 919/1827] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:23 2021] PUT /identity/v3/projects/5b678a76bd0642ba90455880a682c23d/users/37787146e3c648b2af83a15ab2e7c8f9/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:24.181926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:24.182881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:24.183180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:24.265225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] MFA Rules not processed for user `37787146e3c648b2af83a15ab2e7c8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:24.270920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:24.295719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1104b5-84a0-427a-8238-a74ecb9f0d45 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:24.400553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ee5b8d73774ca889e5f5561cc202ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0a971fa52364d78917034acdb3c05ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:24.401568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:24.401568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:24.401854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:24.402649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:24.402967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:24.404979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:24.424176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 909/1828] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:24.429511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:24.456755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 920/1829] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:24 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:24.458389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:24.466763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:24.481578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9e096-a16f-4167-bbc3-84db49f87664 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:24.554349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ee5b8d73774ca889e5f5561cc202ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0a971fa52364d78917034acdb3c05ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:24.556197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:24.556197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:24.556881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:24.558132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:24.569005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:24.668367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb706-c481-42d5-8ae5-49516259ea12 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:24.692331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:24.701160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:24.701897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:24.702540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] PATH_INFO: `/v3/projects/2a93b6cad6fd4b5d94730c6383245124` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:24.708300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a93b6cad6fd4b5d94730c6383245124)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:24.716730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:24.743577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 910/1830] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:24 2021] POST /identity/v3/projects => generated 354 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:24.752201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:24.850546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a93b6cad6fd4b5d94730c6383245124', 'request_id': 'req-bf9f4aba-4684-4828-a79e-7f2dc0531e91'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:24.866823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a93b6cad6fd4b5d94730c6383245124', 'request_id': 'req-bf9f4aba-4684-4828-a79e-7f2dc0531e91'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:24.882092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a93b6cad6fd4b5d94730c6383245124', 'request_id': 'req-bf9f4aba-4684-4828-a79e-7f2dc0531e91'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:24.913447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] The token cache is being invalidate because project 2a93b6cad6fd4b5d94730c6383245124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:24.914353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:24.916025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:24.919951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 921/1831] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:24 2021] DELETE /identity/v3/projects/2a93b6cad6fd4b5d94730c6383245124 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:24.921893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:24.925614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:24.959149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667f-0f72-4d6a-83db-6ee81a6e71c2 tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.108425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4aba-4684-4828-a79e-7f2dc0531e91 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.122925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ee5b8d73774ca889e5f5561cc202ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0a971fa52364d78917034acdb3c05ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.122925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.123620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.124238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.126172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:25.126866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.131412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.161091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 922/1832] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:25.162739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:25.167394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:25.190377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.197196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.198068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.198710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.200792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.206323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.302620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 911/1833] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:24 2021] POST /identity/v3/projects => generated 369 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:25.306335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:25.309728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:25.402187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd4b-1d57-41bb-9b7b-10036b4fb19b tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.437519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47006799-7279-4313-adc8-4b4e69c1e262 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.443174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.444495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.444495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.444720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.445753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.447911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.472713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 912/1834] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:25 2021] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:25.473882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:25.495326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.497665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.498289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.498844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] PATH_INFO: `/v3/users/1bde8a3058bc4e9293f75bfcf8de81cb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.501250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bde8a3058bc4e9293f75bfcf8de81cb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.511405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.588042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bde8a3058bc4e9293f75bfcf8de81cb'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.588839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bde8a3058bc4e9293f75bfcf8de81cb'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.608197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bde8a3058bc4e9293f75bfcf8de81cb'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.618957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414971-f8c7-4c9e-bb66-08f05e8425a0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.625616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ee5b8d73774ca889e5f5561cc202ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0a971fa52364d78917034acdb3c05ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.627017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.627017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.627017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] PATH_INFO: `/v3/projects/9f8f2692c0bc43379258242391f7b214` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.628874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f8f2692c0bc43379258242391f7b214)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.631875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.642237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bde8a3058bc4e9293f75bfcf8de81cb'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.660875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bde8a3058bc4e9293f75bfcf8de81cb'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.672559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 923/1835] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:25 2021] DELETE /identity/v3/users/1bde8a3058bc4e9293f75bfcf8de81cb => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:25.674214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:25.678481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:25.718055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8f2692c0bc43379258242391f7b214', 'request_id': 'req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.733082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8f2692c0bc43379258242391f7b214', 'request_id': 'req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.750048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8f2692c0bc43379258242391f7b214', 'request_id': 'req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.783936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] The token cache is being invalidate because project 9f8f2692c0bc43379258242391f7b214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:25.784232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.786797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:25.792710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 913/1836] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:25 2021] DELETE /identity/v3/projects/9f8f2692c0bc43379258242391f7b214 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:25.826128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06368-38b1-4302-b95a-e80d6d5ba21d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:25.935524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:25.937387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:25.938111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:25.938836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:25.940634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:25.945945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:25.967126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 924/1837] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:25 2021] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:25.973650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:25.975256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.000635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d10e-d7e8-4f6f-999f-5a7b9e132d8c tempest-VolumeQuotaClassesTest-1550569147 tempest-VolumeQuotaClassesTest-1550569147-project-admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.008842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.009775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.010056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.010331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] PATH_INFO: `/v3/projects/853b17ad547540a297d0bd3d44695049/users/33394655efc44baf9eee353eaebe5a57/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.029658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=853b17ad547540a297d0bd3d44695049, user_id=33394655efc44baf9eee353eaebe5a57, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.033559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.053324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 914/1838] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:25 2021] PUT /identity/v3/projects/853b17ad547540a297d0bd3d44695049/users/33394655efc44baf9eee353eaebe5a57/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:26.057562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:26.075819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cae78-4cf7-4832-8902-9d2ee0f21ed4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.113897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:26.117273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.185133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.187612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.188105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.188951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.191531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.196076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.223892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 925/1839] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:26 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:26.230716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:26.250395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701750d-64e0-47d1-b5cf-23153add7a37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.266720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c5d7-71a3-4d18-b47b-19cd03e9fc7b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.277922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.280633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.281099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.281568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] PATH_INFO: `/v3/users/59b725013f714d6bb65821e5a2de3585` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.291236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b725013f714d6bb65821e5a2de3585)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.304732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.308762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.309375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.309984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.310571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] PATH_INFO: `/v3/projects/853b17ad547540a297d0bd3d44695049/users/33394655efc44baf9eee353eaebe5a57/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.320459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853b17ad547540a297d0bd3d44695049, user_id=33394655efc44baf9eee353eaebe5a57, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.325640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.347456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 926/1840] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:26 2021] PUT /identity/v3/projects/853b17ad547540a297d0bd3d44695049/users/33394655efc44baf9eee353eaebe5a57/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:26.352061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:26.355614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.401431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b725013f714d6bb65821e5a2de3585'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.426425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b725013f714d6bb65821e5a2de3585'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.437163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b725013f714d6bb65821e5a2de3585'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.447542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b725013f714d6bb65821e5a2de3585'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.449196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b725013f714d6bb65821e5a2de3585'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.460959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 915/1841] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:26 2021] DELETE /identity/v3/users/59b725013f714d6bb65821e5a2de3585 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:26.462134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:26.463625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.480996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc13d5-41d4-4e9f-96e3-b7c7f77b0dc4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.555839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38d7f8-c5db-40d9-88de-91ea0ea4592e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:26.562068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.562687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.563141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.563427 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] PATH_INFO: `/v3/projects/df1cb577fb0640ea82fdb913504b2dbb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.565236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1cb577fb0640ea82fdb913504b2dbb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.567259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.586833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:26.588008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.588339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.588726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] PATH_INFO: `/v3/users/ee04ec2251374dec94648dc81ab867ef` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.590352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee04ec2251374dec94648dc81ab867ef)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:26.592724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:26.648761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1cb577fb0640ea82fdb913504b2dbb', 'request_id': 'req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.656812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1cb577fb0640ea82fdb913504b2dbb', 'request_id': 'req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.667819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1cb577fb0640ea82fdb913504b2dbb', 'request_id': 'req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.683461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] The token cache is being invalidate because project df1cb577fb0640ea82fdb913504b2dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:26.683739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.684599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9c4e69-3fdb-4371-9549-a2e08dfa4aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.687551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 916/1842] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:26 2021] DELETE /identity/v3/projects/df1cb577fb0640ea82fdb913504b2dbb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:26.688325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2778-ffcf-42b2-940c-0349e4f8cb27 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.688637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2778-ffcf-42b2-940c-0349e4f8cb27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.689018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2778-ffcf-42b2-940c-0349e4f8cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.696066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee04ec2251374dec94648dc81ab867ef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.697337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee04ec2251374dec94648dc81ab867ef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.710592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee04ec2251374dec94648dc81ab867ef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.738005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee04ec2251374dec94648dc81ab867ef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.742092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fd4d2778-ffcf-42b2-940c-0349e4f8cb27 None None] MFA Rules not processed for user `33394655efc44baf9eee353eaebe5a57`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:26.746658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fd4d2778-ffcf-42b2-940c-0349e4f8cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.754830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-59b7fd3b-c1fa-43fd-80ae-24c24122317b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee04ec2251374dec94648dc81ab867ef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:26.766549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 927/1843] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:26 2021] DELETE /identity/v3/users/ee04ec2251374dec94648dc81ab867ef => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:26.771088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf06a-649b-4021-b013-0174de9993ad None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.771401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf06a-649b-4021-b013-0174de9993ad None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.771783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf06a-649b-4021-b013-0174de9993ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.827045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-43caf06a-649b-4021-b013-0174de9993ad None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:26.831373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-43caf06a-649b-4021-b013-0174de9993ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:26.926041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 917/1844] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:26 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:26.926041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.926041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.926041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.969000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 928/1845] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:26.971274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:26.971766 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:26.971920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:26.973471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:26.975597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:27.002781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 918/1846] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:27.006073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.010917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:27.017800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:27.019183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:27.035624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 929/1847] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:27.036829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.039075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:27.204998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76754fa-4545-43ee-8bd6-a139abbfda7a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.227333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.230846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.231291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.231447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.246437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a44e92-6ac2-40bd-b51c-4374dc5c9acb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.271026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.272136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.272860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.273115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.292807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:27.296714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9390b6-80b5-4f23-9835-09a55a730a8c service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:27.318600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 930/1848] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:27.320938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.321370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.321889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.385648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:27.387562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:27.406320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 919/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:27 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:27.407044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:27.407743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.411526 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:27.454321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfe698-fa36-4885-a414-ca5eaf539459 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.460798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 931/1850] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:27.467908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.479526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.481008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.481718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.482207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.541785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:27.544336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:27.563164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cca73-d7d1-46f9-a7e8-b87aacd1fe41 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.589288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 920/1851] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:27.594357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.596949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.597763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.601202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.605799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:27.616844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:27.618917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:27.662292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 932/1852] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:21:27.669568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.701148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6daaf-ce22-4117-a820-6422ef258f9d service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.734042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.735425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.736045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.736642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.737815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:27.745032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:27.833328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 921/1853] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:27 2021] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:27.837901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:27.852460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad571-ccd4-4a1e-937d-d1479471b653 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:27.990064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:27.992248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:27.992715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:27.994909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:27.995978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:28.000099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:28.045319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 933/1854] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:27 2021] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:28.052492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:28.074623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10c267-2af8-426a-a30e-3761799a0029 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:28.081852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:28.082736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:28.083119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:28.083495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:28.084382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:28.086245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:28.109922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 922/1855] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:28 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:28.113054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:28.129566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782969-c9d7-4b60-8617-da2132cb2cc8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:28.141510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:28.148790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:28.148790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:28.148790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:28.156402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:28.162113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a91cf-25cc-4c07-99e3-694078640bd1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:28.198961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 934/1856] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:28 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:28.201566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:28.239515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991302-29b5-4018-917b-f67795454522 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:28.263788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:28.267257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:28.267737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:28.268271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] PATH_INFO: `/v3/projects/7528a41cea5d44909a76c097fa79a775/users/63ead3efa2ac43689d0b005a5bae8e79/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:28.332000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7528a41cea5d44909a76c097fa79a775, user_id=63ead3efa2ac43689d0b005a5bae8e79, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:28.339183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:28.382249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 923/1857] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:28 2021] PUT /identity/v3/projects/7528a41cea5d44909a76c097fa79a775/users/63ead3efa2ac43689d0b005a5bae8e79/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:28.397452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:28.398256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:28.398968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:28.488366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] MFA Rules not processed for user `63ead3efa2ac43689d0b005a5bae8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:28.490763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:28.708160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:28.709281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 935/1858] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:28 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:28.837905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3095c2-03a9-4bb5-a865-532aaa40778b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:28.849607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:28.851392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:28.853447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:28.853974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:28.856864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:28.863251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:28.932082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 924/1859] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:28 2021] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:28.936890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:28.951104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaec5d-e1ae-4741-85ee-d8a3933f3d85 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:29.084599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:29.084599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.084599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.084599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.085451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:29.085451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:29.123369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 936/1860] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:28 2021] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:29.127710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.140890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a0df-8c14-4bb0-9781-174a97732211 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:29.149466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:29.150338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.150719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.151165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.152084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:29.155116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:29.170260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 925/1861] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:29 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:29.174876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.188041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ae37-9d51-4b9b-af49-43eeb6e57979 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:29.195316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:29.196680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.197157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.197640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] PATH_INFO: `/v3/projects/2d186d51bd724effb37ad01bb21f947a/users/b6c2e539c9d34ed0ad34b426b3763640/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.219726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d186d51bd724effb37ad01bb21f947a, user_id=b6c2e539c9d34ed0ad34b426b3763640, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:29.224691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:29.254156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 937/1862] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:29 2021] PUT /identity/v3/projects/2d186d51bd724effb37ad01bb21f947a/users/b6c2e539c9d34ed0ad34b426b3763640/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:29.254733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.275440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf690-cea3-4017-a6d7-3e147bd72bce admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:29.424779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:29.425499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.425790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.426068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.426855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:29.434521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ad0c1-8b09-409c-a7bf-f227bff84e2c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:29.457193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 926/1863] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:29 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:29.464267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.503572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558965-6eaf-4f5b-ab99-3e87454c986a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:29.529152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:29.531203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.531821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.532453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] PATH_INFO: `/v3/projects/2d186d51bd724effb37ad01bb21f947a/users/b6c2e539c9d34ed0ad34b426b3763640/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.536596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d186d51bd724effb37ad01bb21f947a, user_id=b6c2e539c9d34ed0ad34b426b3763640, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:29.545139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:29.595282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 938/1864] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:29 2021] PUT /identity/v3/projects/2d186d51bd724effb37ad01bb21f947a/users/b6c2e539c9d34ed0ad34b426b3763640/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:29.615601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:29.616134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:29.616617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:29.687041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] MFA Rules not processed for user `b6c2e539c9d34ed0ad34b426b3763640`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:29.689594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:29.827941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.837411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:29.908640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 927/1865] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:29 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:29.927963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:29.930389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:30.010406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e46d-8970-4a40-9103-082ebdf5d847 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:30.022337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:30.024341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:30.025367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:30.026115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] PATH_INFO: `/v3/projects/cab00bede9ad45759c69504666a78b57` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:30.029072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab00bede9ad45759c69504666a78b57)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:30.035385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:30.082354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a523-010c-47e8-9f8b-84bbe5457194 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:30.107279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:30.114647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:30.114879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:30.115134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:30.181623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab00bede9ad45759c69504666a78b57', 'request_id': 'req-25d33c38-9bd0-4136-bef8-57008a7d0959'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.205094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab00bede9ad45759c69504666a78b57', 'request_id': 'req-25d33c38-9bd0-4136-bef8-57008a7d0959'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.216172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:30.218147 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:30.219775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab00bede9ad45759c69504666a78b57', 'request_id': 'req-25d33c38-9bd0-4136-bef8-57008a7d0959'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.246990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 928/1866] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:29 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:21:30.273480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] The token cache is being invalidate because project cab00bede9ad45759c69504666a78b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:30.273849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.278009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.284175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 939/1867] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:29 2021] DELETE /identity/v3/projects/cab00bede9ad45759c69504666a78b57 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:30.306830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:30.343091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:30.346072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:30.359674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a4ef-c8ca-48ae-9fd1-3ce3829b6449 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:30.528202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d33c38-9bd0-4136-bef8-57008a7d0959 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:30.539501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:30.542767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:30.543581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:30.544360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] PATH_INFO: `/v3/projects/9928910518854a80a532b31719f199d8` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:30.547795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9928910518854a80a532b31719f199d8)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:30.553821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:30.610733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:30.612296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:30.612793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:30.613240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] PATH_INFO: `/v3/users/68ee5b8d73774ca889e5f5561cc202ba` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:30.615568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ee5b8d73774ca889e5f5561cc202ba)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:30.619218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:30.684946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9928910518854a80a532b31719f199d8', 'request_id': 'req-63e5cc71-0e0e-4fb6-955c-915986aa60f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.709545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9928910518854a80a532b31719f199d8', 'request_id': 'req-63e5cc71-0e0e-4fb6-955c-915986aa60f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.730297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9928910518854a80a532b31719f199d8', 'request_id': 'req-63e5cc71-0e0e-4fb6-955c-915986aa60f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.736828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ee5b8d73774ca889e5f5561cc202ba'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.754126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ee5b8d73774ca889e5f5561cc202ba'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.765285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ee5b8d73774ca889e5f5561cc202ba'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.776313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ee5b8d73774ca889e5f5561cc202ba'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.777890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ee5b8d73774ca889e5f5561cc202ba'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.782039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] The token cache is being invalidate because project 9928910518854a80a532b31719f199d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:30.782318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.783257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:30.788559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 940/1868] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:30 2021] DELETE /identity/v3/projects/9928910518854a80a532b31719f199d8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:30.792718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:30.794450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:30.798109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 929/1869] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:30 2021] DELETE /identity/v3/users/68ee5b8d73774ca889e5f5561cc202ba => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:30.951281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5cc71-0e0e-4fb6-955c-915986aa60f8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:31.113488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:31.115004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:31.115504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:31.115993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] PATH_INFO: `/v3/users/b69ef1a9021f4cd4a889c22a6488f30a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:31.130609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69ef1a9021f4cd4a889c22a6488f30a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:31.158387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:31.318898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69ef1a9021f4cd4a889c22a6488f30a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.333696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69ef1a9021f4cd4a889c22a6488f30a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.346307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:31.348305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:31.355777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69ef1a9021f4cd4a889c22a6488f30a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.388237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69ef1a9021f4cd4a889c22a6488f30a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.397904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858ef9f-f9c4-4f76-ac9a-5fb2a69b75db admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:31.413393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:31.414088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69ef1a9021f4cd4a889c22a6488f30a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.416744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:31.418082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:31.418407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] PATH_INFO: `/v3/projects/b0a971fa52364d78917034acdb3c05ae` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:31.421867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a971fa52364d78917034acdb3c05ae)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:31.430808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:31.434159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 941/1870] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:30 2021] DELETE /identity/v3/users/b69ef1a9021f4cd4a889c22a6488f30a => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:31.469294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:31.475889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:31.648805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a971fa52364d78917034acdb3c05ae', 'request_id': 'req-498ef17f-65e8-4f50-bda8-c51f54608728'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.660988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a971fa52364d78917034acdb3c05ae', 'request_id': 'req-498ef17f-65e8-4f50-bda8-c51f54608728'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.673921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a971fa52364d78917034acdb3c05ae', 'request_id': 'req-498ef17f-65e8-4f50-bda8-c51f54608728'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.684328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb432-e462-42e7-b047-c616a4d77e0e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:31.702558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] The token cache is being invalidate because project b0a971fa52364d78917034acdb3c05ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:31.705649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.707001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-498ef17f-65e8-4f50-bda8-c51f54608728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.712646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 930/1871] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:31 2021] DELETE /identity/v3/projects/b0a971fa52364d78917034acdb3c05ae => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:31.723078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820972-27dd-446f-a5b6-9a68c72b44cf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:31.725012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820972-27dd-446f-a5b6-9a68c72b44cf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:31.725337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820972-27dd-446f-a5b6-9a68c72b44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:31.775902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f8820972-27dd-446f-a5b6-9a68c72b44cf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:31.783780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f8820972-27dd-446f-a5b6-9a68c72b44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:31.804913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:31.809678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:31.809678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:31.809678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] PATH_INFO: `/v3/users/37787146e3c648b2af83a15ab2e7c8f9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:31.815797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37787146e3c648b2af83a15ab2e7c8f9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:31.824536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:31.832083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 931/1872] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:31.840587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:31.841740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:31.843102 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:31.911352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:31.914349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:31.932266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 932/1873] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:31.936492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:31.976082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37787146e3c648b2af83a15ab2e7c8f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.977920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37787146e3c648b2af83a15ab2e7c8f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:31.985480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4947ea-d08f-499a-a4ec-f748e0f2217d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:31.993490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37787146e3c648b2af83a15ab2e7c8f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.011408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37787146e3c648b2af83a15ab2e7c8f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.012815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.013971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.014455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.014927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.016260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:32.022278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b814370f-3d66-42ba-a16c-1be3cedffc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37787146e3c648b2af83a15ab2e7c8f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.022474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.029820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.034316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 942/1874] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:31 2021] DELETE /identity/v3/users/37787146e3c648b2af83a15ab2e7c8f9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:32.036381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.036794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.037141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.068742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 933/1875] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:21:32.073248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.079716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.086886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:32.090334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.110127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78ef2-1aad-4472-8223-29179d54f6ab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.279255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.280233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.280838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.281261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.282245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.286269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.290386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 943/1876] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:32.305101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.307807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.328306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016e720-67e8-4be7-a544-25ef6726a4a6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.340907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.348013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.350599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.351659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] PATH_INFO: `/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.356647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3218a8d9cb0e4861ae85926da5a99c5c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.367728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.376225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 934/1877] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:32 2021] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:32.377063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.382076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.494871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3218a8d9cb0e4861ae85926da5a99c5c', 'request_id': 'req-9472cc91-27d9-4b56-895b-bf426f0dbda0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.508390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3218a8d9cb0e4861ae85926da5a99c5c', 'request_id': 'req-9472cc91-27d9-4b56-895b-bf426f0dbda0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.520245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3218a8d9cb0e4861ae85926da5a99c5c', 'request_id': 'req-9472cc91-27d9-4b56-895b-bf426f0dbda0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.523169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06459-f7e5-4e00-935e-65d8fd3a55f0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.554684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] The token cache is being invalidate because project 3218a8d9cb0e4861ae85926da5a99c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:32.555789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.558896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:32.574383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 944/1878] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:32 2021] DELETE /identity/v3/projects/3218a8d9cb0e4861ae85926da5a99c5c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:32.576775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.584123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.770236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472cc91-27d9-4b56-895b-bf426f0dbda0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.783612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.789211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.789875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.791326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.804363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.807656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.811218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.832793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.833260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.834739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.838452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.851857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.855335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f7e74-85ce-49e0-9229-bb7e7e836601 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.871392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 935/1879] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:32.873076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc73d-e597-471b-9853-1570768d048f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.873484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc73d-e597-471b-9853-1570768d048f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.873856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc73d-e597-471b-9853-1570768d048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.878989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 945/1880] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:32 2021] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:32.881350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.896248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3b6bc73d-e597-471b-9853-1570768d048f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:32.898436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3b6bc73d-e597-471b-9853-1570768d048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.901445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2806d1-6864-4e69-bf3b-13480701ee56 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.910649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.911934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.919010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 936/1881] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:32.919710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.919710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.919710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.919710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.920800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.921140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.921425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.944491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 946/1882] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:32 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:32.947745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.947951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:32.949155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:32.962452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 937/1883] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:32.966287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d3bc-53e1-4bb5-85ba-f923deacc4c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:32.971875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:32.972626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:32.972908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:32.973194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:32.973969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:32.974182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:32.975803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:32.993497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 947/1884] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:32 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:32.994537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.007704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc708-fe3d-4c4d-a2ea-81d18a5c9312 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.013103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.014319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.014637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.015204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6819438-04c0-412b-a907-21da73e22c9d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.015590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] PATH_INFO: `/v3/projects/805e86771754450ba72684e0d2fc7d3b/users/d703d813efc04223a834be0c7958b30b/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.034226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.034226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.034226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.034226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.042827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:33.042827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.043910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.044173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e86771754450ba72684e0d2fc7d3b, user_id=d703d813efc04223a834be0c7958b30b, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.048580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fceb6a4-ff1b-4cbf-b268-edf717a76f8a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.083881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 938/1886] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:33.084177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 948/1886] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:32 2021] PUT /identity/v3/projects/805e86771754450ba72684e0d2fc7d3b/users/d703d813efc04223a834be0c7958b30b/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:33.085626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.091816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.092585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.093827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.108577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e915b-a89b-4e8c-b974-b0abc9f65a4b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.153581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] MFA Rules not processed for user `d703d813efc04223a834be0c7958b30b`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:33.154849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.277263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.278688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.279789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.279931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.281655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.286209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.299636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 949/1887] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:33.304387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.322891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2cd8-0d4b-4a47-a240-3ae9d5e1f7d2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.332963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.333596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.334035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.334261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.335084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.338016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.349860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 939/1888] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:33 2021] POST /identity/v3/projects => generated 393 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:33.350960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.408919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 950/1889] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:33 2021] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:33.412456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.473530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e0b-1c41-46c4-ac28-72a2c7eb33ac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.526393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e656fc-186e-464f-a25d-61738c9102e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.532213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.534048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.534422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.534761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.535589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.537668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.563505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 951/1890] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:33 2021] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:33.565686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.567575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.571627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.573064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.573510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.574093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.575323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.581230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.584361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425cd87-238f-40bc-bc7e-844486b84213 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.596561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.597952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.598343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.598622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] PATH_INFO: `/v3/projects/5b678a76bd0642ba90455880a682c23d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.600331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b678a76bd0642ba90455880a682c23d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.602966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.609605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 940/1891] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:33 2021] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:33.610659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.625524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bd6a0-b577-48a9-beb2-8350152bbdea admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.630958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.631645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.631910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.632173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.632962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.634584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.645726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 941/1892] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:33.646620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.657652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1089c-ff72-4e2c-8629-5882ffaf9d27 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.664255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b678a76bd0642ba90455880a682c23d', 'request_id': 'req-076cda4a-b8e1-4322-910d-36bd03588b7e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.686474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b678a76bd0642ba90455880a682c23d', 'request_id': 'req-076cda4a-b8e1-4322-910d-36bd03588b7e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.694546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b678a76bd0642ba90455880a682c23d', 'request_id': 'req-076cda4a-b8e1-4322-910d-36bd03588b7e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.712448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] The token cache is being invalidate because project 5b678a76bd0642ba90455880a682c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:33.712947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.714039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.716724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 952/1893] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:33 2021] DELETE /identity/v3/projects/5b678a76bd0642ba90455880a682c23d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:33.719911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.720365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.731236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.731941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.732203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.732472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.733266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.734900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.746553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 942/1894] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:33.751068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.751068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.762605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de651af-94dd-4c90-aa70-2b1e537cd8bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.768003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.768808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.769086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.769361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] PATH_INFO: `/v3/users/33394655efc44baf9eee353eaebe5a57` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.770842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33394655efc44baf9eee353eaebe5a57)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.772894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.804038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda4a-b8e1-4322-910d-36bd03588b7e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.809859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.810961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.811317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.811452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] PATH_INFO: `/v3/projects/c0dd18d02a7543caa0883687b0579193/users/76cee67ad6e0422aabcbc33abe461ba5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.835469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33394655efc44baf9eee353eaebe5a57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.835994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dd18d02a7543caa0883687b0579193, user_id=76cee67ad6e0422aabcbc33abe461ba5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.841400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:33.853487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33394655efc44baf9eee353eaebe5a57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.862848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33394655efc44baf9eee353eaebe5a57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.866704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 953/1895] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:33 2021] PUT /identity/v3/projects/c0dd18d02a7543caa0883687b0579193/users/76cee67ad6e0422aabcbc33abe461ba5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:33.867901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.871442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.874316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33394655efc44baf9eee353eaebe5a57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.875042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33394655efc44baf9eee353eaebe5a57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:33.884586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 943/1896] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:33 2021] DELETE /identity/v3/users/33394655efc44baf9eee353eaebe5a57 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:33.884586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:33.886746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:33.986161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d66ce-7db3-4a1d-97c7-cff794f85712 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:33.994931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:33.995704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:33.995986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:33.996263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:33.997086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:33.999211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.004791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9eca-3cf0-44c3-82cb-7ebae8f7328f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.015727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 944/1897] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:34.017656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.029528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331ac5-e536-49d2-9564-7a2fff1bead8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.030656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.033044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.033044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.036632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.037664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.037960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.039053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.039340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.039659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] PATH_INFO: `/v3/projects/c0dd18d02a7543caa0883687b0579193/users/76cee67ad6e0422aabcbc33abe461ba5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.042289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.042938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dd18d02a7543caa0883687b0579193, user_id=76cee67ad6e0422aabcbc33abe461ba5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.047629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e60ad0-8be5-4b9d-9a71-594540c8645c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.076045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 954/1899] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:34.077302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.079986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 945/1899] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:34 2021] PUT /identity/v3/projects/c0dd18d02a7543caa0883687b0579193/users/76cee67ad6e0422aabcbc33abe461ba5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:34.080220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.081485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.081908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.082067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.102808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749844ad-2c23-4035-997b-e6eac97e20a5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.114420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] MFA Rules not processed for user `76cee67ad6e0422aabcbc33abe461ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:34.115759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.198126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.199423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.199626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.199908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] PATH_INFO: `/v3/projects/0f7c1a42642c4a67ab6e2dac5f2de628/users/bf6ce5b6316b4119bc5a898590d2a843/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.213269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 946/1900] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:34 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:34.225733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.228039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.228843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7c1a42642c4a67ab6e2dac5f2de628, user_id=bf6ce5b6316b4119bc5a898590d2a843, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.234363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36613c-01dc-44d2-959d-be38f284daae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.268557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 955/1901] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:34 2021] PUT /identity/v3/projects/0f7c1a42642c4a67ab6e2dac5f2de628/users/bf6ce5b6316b4119bc5a898590d2a843/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:34.287377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.288009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.288662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.327561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] MFA Rules not processed for user `bf6ce5b6316b4119bc5a898590d2a843`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:34.329559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.362774 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fd486-73f8-4671-8dc6-f71e9fcf64ee None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.486400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 956/1902] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:34 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:34.488080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.490283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.492272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.493137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.493482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.493815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.580037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.583695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.586567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd468-c7bd-415b-8e6a-46eaaefb8db5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.591463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.592388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.592702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.592975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] PATH_INFO: `/v3/projects/853b17ad547540a297d0bd3d44695049` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.594269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853b17ad547540a297d0bd3d44695049)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.596651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.605763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 947/1903] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:34 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:21:34.607924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.627763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129666d-7fee-4575-88ef-7f3c7b136ad9 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.636300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.637995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.638466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.639023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.640871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.646411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.693700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853b17ad547540a297d0bd3d44695049', 'request_id': 'req-fe31a172-fb5d-4926-bdcd-763601974e68'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:34.706395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853b17ad547540a297d0bd3d44695049', 'request_id': 'req-fe31a172-fb5d-4926-bdcd-763601974e68'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:34.716591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 948/1904] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:34 2021] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:34.722284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.739052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853b17ad547540a297d0bd3d44695049', 'request_id': 'req-fe31a172-fb5d-4926-bdcd-763601974e68'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:34.763611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] The token cache is being invalidate because project 853b17ad547540a297d0bd3d44695049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:34.764029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:34.764914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fe31a172-fb5d-4926-bdcd-763601974e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:34.767117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 957/1905] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:34 2021] DELETE /identity/v3/projects/853b17ad547540a297d0bd3d44695049 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:34.786352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.787791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.788147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.855348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1281-1301-42b5-896a-4798798b7a91 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:34.871525 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:34.872947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:34.873642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:34.874117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:34.875537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:34.880505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:34.917521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 949/1906] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:34 2021] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:34.918750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.920798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.955742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:34.957745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:34.971505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 958/1907] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:34.983413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:34.984900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:35.000301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e341-f8d4-44ae-a80f-7a9d366bf0b5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.000557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889f2ac-c477-409c-abb1-7d7a15944378 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.010947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.011618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.011712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.012011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.012123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.012297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.012763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.013033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.013805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.015216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:35.015423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7adab-22ce-4297-a21f-39b3f8d51171 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.026917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 959/1908] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:34 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:35.028290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.028651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.028905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.048041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:35.050304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:35.059067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 960/1909] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:35.059624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.070903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecb14-f69a-4dea-a898-6d3fab2ad196 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.075683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.076726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.077052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.077513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] PATH_INFO: `/v3/projects/2a29e6fe61f644bfb53c40ea790e0755/users/086b94da3c5143e29c0a4eba35734d27/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.100958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a29e6fe61f644bfb53c40ea790e0755, user_id=086b94da3c5143e29c0a4eba35734d27, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.106334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.112958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.115708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.129506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 961/1910] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:35 2021] PUT /identity/v3/projects/2a29e6fe61f644bfb53c40ea790e0755/users/086b94da3c5143e29c0a4eba35734d27/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:35.131223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.137518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 950/1911] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:34 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:35.138665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.151224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ec9d-4957-410a-8718-888683ced5bd service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.242471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.243677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.244225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.244828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.246668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.250360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.265173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75c8ca-b804-4aae-a17f-9223f6fe71f0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.271209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.271909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.272183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.272474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.273391 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:35.273944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.275718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.280151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 951/1912] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:35.287045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.299595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067358-a967-4ba2-9cc7-047e0f7e825f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.309306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 962/1913] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:35.309561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.309561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.309561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.309561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] PATH_INFO: `/v3/projects/2a29e6fe61f644bfb53c40ea790e0755/users/086b94da3c5143e29c0a4eba35734d27/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.310092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a29e6fe61f644bfb53c40ea790e0755, user_id=086b94da3c5143e29c0a4eba35734d27, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.311430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6f8cf-356e-460f-b7d7-08724b416056 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.311964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.328798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 952/1914] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:35 2021] PUT /identity/v3/projects/2a29e6fe61f644bfb53c40ea790e0755/users/086b94da3c5143e29c0a4eba35734d27/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:35.334985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a832-c284-40b6-b530-b593290ef94e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.338642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.339494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.340250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.386032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] MFA Rules not processed for user `086b94da3c5143e29c0a4eba35734d27`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:35.388005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:35.466937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.468341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.469732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.470426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.472345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.476022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.507657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 953/1915] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:35 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:35.527481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 963/1916] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:35 2021] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:35.529714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.550776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89324935-73b0-4a6d-8e20-3e74b1388409 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.700833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.705901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.705901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.706338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.706810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.710150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.729543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.745095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 954/1917] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:35 2021] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:35.762855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.801203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0427-4efb-4925-a1ca-3996899ff071 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.823520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.824874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.825359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.839329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.841001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.848398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.869340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 955/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:35.873292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.886469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30693579-91e5-4feb-9c88-894cc2240a1f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.897422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.898728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.899305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.900189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.902141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:35.906702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:35.912626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d294-4569-46e8-8071-744967647f59 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.925893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.926542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.926844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.927119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:35.943263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 956/1919] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:35 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:35.951087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:35.983394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be55e-c556-479e-8be3-a7dbd5caf8a4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:35.993967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:35.995742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:35.995742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:35.996337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] PATH_INFO: `/v3/projects/b5ddb38d4f9b4c5aaa520be3b362267f/users/0ee14691a669495a9acedc677a896455/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.018685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ddb38d4f9b4c5aaa520be3b362267f, user_id=0ee14691a669495a9acedc677a896455, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.022045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.041011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 957/1920] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:35 2021] PUT /identity/v3/projects/b5ddb38d4f9b4c5aaa520be3b362267f/users/0ee14691a669495a9acedc677a896455/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:36.045672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.047505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:36.056691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.058349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ae01b-31ba-4ea5-868a-020be525da49 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.070712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 964/1921] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:35 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:36.072299 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.072617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.072943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.106637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] MFA Rules not processed for user `0ee14691a669495a9acedc677a896455`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:36.107486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:36.136108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063265c-146a-4cda-adcf-08718e76866f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.143306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.144802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.144802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.144802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.150279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:36.209073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 965/1922] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:36.210576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.222539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15bf2-3db6-4448-bc7b-631be0055b4c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.229220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.230323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.231079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.231465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.235951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:36.253359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.255348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.270742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 958/1923] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:36 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:36.271603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.359773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44243-adc4-4671-a27c-3099def58ede service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.364823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.366298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.367048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.367755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.368038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.368511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.369307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.372213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.377758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 966/1924] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:36 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:36.420560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 959/1925] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:36 2021] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:36.424631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.439839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55c6a-a532-48bb-998b-8e1a68953cc7 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.524038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.526099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.526099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.526340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.527782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.531584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.563659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 967/1926] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:36 2021] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:36.569239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.582513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa29d-4bbc-4d42-b493-6d1de8cafacc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.588678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.589594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.589902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.590353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.591431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.593405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.610094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 960/1927] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:36.616384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.635834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335299f0-20ff-4f89-ad38-8d7b203133a0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.642927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.645236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.645905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.646517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] PATH_INFO: `/v3/projects/39b00d5cf4b149c580f782116bb6263c/users/2ae8890ae6854a8abb6225ae05dc4fe9/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.680537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b00d5cf4b149c580f782116bb6263c, user_id=2ae8890ae6854a8abb6225ae05dc4fe9, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.687323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.716691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 968/1928] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:36 2021] PUT /identity/v3/projects/39b00d5cf4b149c580f782116bb6263c/users/2ae8890ae6854a8abb6225ae05dc4fe9/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:36.723685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.743856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754e4d-f429-4284-90da-6fc5a7662b5b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.834553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.836024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.836340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.836806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.838104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.840692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bc04c-d3be-40bc-b4c8-66c9e50e5d86 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.870272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 961/1929] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:36.876358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:36.913257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811b27-99a4-4f5e-9e1a-b74f4faa9883 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:36.952168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:36.953879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:36.954646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:36.955212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] PATH_INFO: `/v3/projects/39b00d5cf4b149c580f782116bb6263c/users/2ae8890ae6854a8abb6225ae05dc4fe9/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:36.960121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b00d5cf4b149c580f782116bb6263c, user_id=2ae8890ae6854a8abb6225ae05dc4fe9, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:36.968697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:36.990092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 969/1930] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:36 2021] PUT /identity/v3/projects/39b00d5cf4b149c580f782116bb6263c/users/2ae8890ae6854a8abb6225ae05dc4fe9/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:37.010537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:37.010976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:37.011274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:37.064329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] MFA Rules not processed for user `2ae8890ae6854a8abb6225ae05dc4fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:37.072950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:37.245910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 962/1931] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:37 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:37.450885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:37.574783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688d210-6477-46c0-be19-2eabe6c3511b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:37.591532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:37.593587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:37.594300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:37.594980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:37.618932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:37.622537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3b33-d246-49df-9e5a-11fa3efbe149 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:37.648813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 970/1932] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:37 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:21:37.881199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:37.975359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c67f-561c-487b-828d-a1c4997b5bf3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:37.981245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:37.982433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:37.982789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:37.983013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] PATH_INFO: `/v3/users/0ee14691a669495a9acedc677a896455` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:37.984425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee14691a669495a9acedc677a896455)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:37.986549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:38.056190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee14691a669495a9acedc677a896455'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.074880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee14691a669495a9acedc677a896455'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.084490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee14691a669495a9acedc677a896455'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.094688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee14691a669495a9acedc677a896455'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.097578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee14691a669495a9acedc677a896455'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.104855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 963/1933] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:37 2021] DELETE /identity/v3/users/0ee14691a669495a9acedc677a896455 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:38.111864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:38.112372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:38.112737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:38.133454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:38.134829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:38.234950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 971/1934] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:38.241089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:38.242606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:38.352463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508a83-4b58-4282-b02b-760eda57754f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:38.359552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:38.360788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:38.361765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:38.362074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:38.377571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:38.380242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:38.395953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 964/1935] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:38.774178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:38.776498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:38.799615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660ab1-af61-4b2a-9039-6c8dddaccdad None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:38.804045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:38.804989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:38.805593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:38.805593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] PATH_INFO: `/v3/projects/b5ddb38d4f9b4c5aaa520be3b362267f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:38.807026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ddb38d4f9b4c5aaa520be3b362267f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:38.809208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:38.910670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ddb38d4f9b4c5aaa520be3b362267f', 'request_id': 'req-840746e8-8978-47e4-b7d5-df594cda70d1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.925008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ddb38d4f9b4c5aaa520be3b362267f', 'request_id': 'req-840746e8-8978-47e4-b7d5-df594cda70d1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.934656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ddb38d4f9b4c5aaa520be3b362267f', 'request_id': 'req-840746e8-8978-47e4-b7d5-df594cda70d1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.952507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] The token cache is being invalidate because project b5ddb38d4f9b4c5aaa520be3b362267f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:38.952796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.953774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:38.957509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 972/1936] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:38 2021] DELETE /identity/v3/projects/b5ddb38d4f9b4c5aaa520be3b362267f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:38.961535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:38.975987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319158e-a62b-4619-8b89-34b8d5ac5f3e service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:39.061168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:39.062759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.063044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.063542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] PATH_INFO: `/v3/users/2ae8890ae6854a8abb6225ae05dc4fe9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.065131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae8890ae6854a8abb6225ae05dc4fe9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:39.067095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:39.141627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae8890ae6854a8abb6225ae05dc4fe9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.157413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae8890ae6854a8abb6225ae05dc4fe9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.168207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae8890ae6854a8abb6225ae05dc4fe9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.178405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae8890ae6854a8abb6225ae05dc4fe9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.179353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bf793d07-0f97-49b6-aad0-72037e323e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae8890ae6854a8abb6225ae05dc4fe9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.187375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 965/1937] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:38 2021] DELETE /identity/v3/users/2ae8890ae6854a8abb6225ae05dc4fe9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:39.524976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:39.527537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:39.557751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840746e8-8978-47e4-b7d5-df594cda70d1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:39.641797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:39.643077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.643365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.643710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] PATH_INFO: `/v3/projects/39b00d5cf4b149c580f782116bb6263c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.645612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b00d5cf4b149c580f782116bb6263c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:39.649010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:39.728240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b00d5cf4b149c580f782116bb6263c', 'request_id': 'req-58388613-5de2-4247-83ba-c17f4ce09a44'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.739882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b00d5cf4b149c580f782116bb6263c', 'request_id': 'req-58388613-5de2-4247-83ba-c17f4ce09a44'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.750114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b00d5cf4b149c580f782116bb6263c', 'request_id': 'req-58388613-5de2-4247-83ba-c17f4ce09a44'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.766016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] The token cache is being invalidate because project 39b00d5cf4b149c580f782116bb6263c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:39.766309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.767034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-58388613-5de2-4247-83ba-c17f4ce09a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:39.769242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 973/1938] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:39 2021] DELETE /identity/v3/projects/39b00d5cf4b149c580f782116bb6263c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:39.776704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.777191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.777572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.798627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:39.800041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:39.864322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 966/1939] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:39.873738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.874314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.874314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.895349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:39.896655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:39.906046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 974/1940] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:39.911299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:39.921882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c560402-89ef-4580-8130-e4096fc8de70 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:39.928285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:39.929030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.929313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.929586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.930394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:39.930701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:39.932577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:39.947034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 967/1941] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:39.952500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:39.969024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09016c-9b86-4ab0-93d9-6b718a3729f6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:39.977211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:39.978742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:39.979214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:39.979676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:39.981022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:39.984725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.047463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 975/1942] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:39 2021] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:40.053133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.073617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e337-7407-491e-b8c2-be96605d9a54 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.179200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.180041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.180420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.180840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.181665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.183887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.208838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 968/1943] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:40 2021] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:40.213611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.225024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746564-7c4e-4408-9bb8-05b7e9e97b44 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.230583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.231275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.231558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.231829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.232853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.234486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.246961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 976/1944] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:40.251735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.268565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31df7d-81f4-4b1c-9e83-2d1349341b91 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.275059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.275937 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.276020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.276336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.277528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.279233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d024c9b-9ba0-43a8-951f-765e6faf0958 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.291832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 969/1945] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:40.306484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.318713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16880e-e965-48f1-91f0-d81324530c71 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.323702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.324687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.324968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.325240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] PATH_INFO: `/v3/projects/ad9c32935418493d9f0fe633a8209840/users/0f773eee993048b08e43d182c1dec425/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.344629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9c32935418493d9f0fe633a8209840, user_id=0f773eee993048b08e43d182c1dec425, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.347626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.369466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 977/1946] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:40 2021] PUT /identity/v3/projects/ad9c32935418493d9f0fe633a8209840/users/0f773eee993048b08e43d182c1dec425/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:40.388582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.389043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.389531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.426293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] MFA Rules not processed for user `0f773eee993048b08e43d182c1dec425`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:40.427549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:40.503707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 970/1947] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:40 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:40.509302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.609879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643981-faed-4acf-9c07-888737b2f393 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.615878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.616596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.616878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.617150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.617889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.619840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.648784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 978/1948] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:40 2021] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:40.654470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.668169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298426a2-17f2-4e10-829f-aa2de08d3506 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.755404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.756187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.756722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.757313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.757959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.760223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.785231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 971/1949] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:40 2021] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:40.789215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.802956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1887-145e-47da-9141-29c98ee17ba3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.809029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.810117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.810731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.811109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.812012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.814530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.831281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 979/1950] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:40 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:40.836327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.855054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b238-b90f-4a53-8d74-68bb9e220043 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.863844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.864875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.865161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.865443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] PATH_INFO: `/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7/users/e7f33f0f45dc4ebfa5b8e37adca4f900/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.885597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28ab67e198642cd805c9c5b4fe8a1b7, user_id=e7f33f0f45dc4ebfa5b8e37adca4f900, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.888918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:40.913053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 972/1951] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:40 2021] PUT /identity/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7/users/e7f33f0f45dc4ebfa5b8e37adca4f900/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:40.914000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:40.925740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2965aed-53db-45e7-b453-d39148e0b669 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:40.993304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:40.994033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:40.994311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:40.994581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:40.995352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:40.997033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87052bc-9b16-423e-af8d-bd5e7b15326c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:41.008855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 980/1952] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:40 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:41.013322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:41.024457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b047-3ca9-4811-92d8-2837b5ff1832 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:41.029516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:41.030437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.030722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.031007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] PATH_INFO: `/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7/users/e7f33f0f45dc4ebfa5b8e37adca4f900/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.033253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28ab67e198642cd805c9c5b4fe8a1b7, user_id=e7f33f0f45dc4ebfa5b8e37adca4f900, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:41.035996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:41.052239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 973/1953] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:41 2021] PUT /identity/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7/users/e7f33f0f45dc4ebfa5b8e37adca4f900/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:41.064253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.064775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.065268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.135901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] MFA Rules not processed for user `e7f33f0f45dc4ebfa5b8e37adca4f900`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:41.140761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:41.308901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 981/1954] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:41 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:41.342118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:41.350599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:41.455850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869951a2-3bf1-4cd2-82ff-b591487ae3d3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:41.460348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:41.461212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.461601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.461981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.495204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:41.499021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:41.518878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 974/1955] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:41 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:41.669392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:41.692948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f46ec-2e07-4318-b303-8bb006e98503 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:41.698892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:41.699934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:41.700042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.700400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.700866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.701967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:41.784667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2ea-0b3b-4e9e-925c-a9b34bad3400 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:41.790565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:41.791607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.792066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.792512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] PATH_INFO: `/v3/users/bf6ce5b6316b4119bc5a898590d2a843` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.793511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:41.793842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6ce5b6316b4119bc5a898590d2a843)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:41.795821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:41.796157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b1fec-cb41-4a2d-901c-241f26f6c2ef service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:41.817006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 982/1956] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:41 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:41.855610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6ce5b6316b4119bc5a898590d2a843'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:41.881317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6ce5b6316b4119bc5a898590d2a843'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:41.892194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6ce5b6316b4119bc5a898590d2a843'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:41.901472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6ce5b6316b4119bc5a898590d2a843'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:41.902340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6ce5b6316b4119bc5a898590d2a843'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:41.910085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 975/1957] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:41 2021] DELETE /identity/v3/users/bf6ce5b6316b4119bc5a898590d2a843 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:41.915700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:41.916201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:41.916357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:41.961435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:41.964772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.096398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 983/1958] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:42.108464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:42.109934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.172593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:42.174855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.186166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d447af-1410-4c8d-8257-684b61c2021f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:42.186884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b846185-ca82-417d-9e4c-70573f8a24a3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:42.193129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:42.194135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:42.194427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:42.194725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] PATH_INFO: `/v3/users/d703d813efc04223a834be0c7958b30b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:42.196403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d703d813efc04223a834be0c7958b30b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:42.199055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:42.199634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:42.200881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:42.201607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:42.202540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:42.223882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:42.227326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725692ed-de02-4251-a5fe-350f4b8a09fb service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:42.257122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 976/1959] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:21:42.307007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd703d813efc04223a834be0c7958b30b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.308617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd703d813efc04223a834be0c7958b30b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.321601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd703d813efc04223a834be0c7958b30b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.340144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd703d813efc04223a834be0c7958b30b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.352230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd703d813efc04223a834be0c7958b30b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.362602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 984/1960] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:42 2021] DELETE /identity/v3/users/d703d813efc04223a834be0c7958b30b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:42.368123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:42.369140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:42.369683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:42.397473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:42.399027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.490211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 977/1961] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:42.503661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:42.505824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.625674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa57-080c-4e28-884e-66f499f8a681 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:42.631285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:42.632072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:42.632260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:42.632573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:42.644365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:42.645878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:42.657479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 985/1962] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:42.727718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:42.731401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:42.760192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646c669-691e-405d-8d0e-90e9e00af73e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:42.770123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:42.770399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:42.770654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:42.773376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] PATH_INFO: `/v3/projects/0f7c1a42642c4a67ab6e2dac5f2de628` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:42.776408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7c1a42642c4a67ab6e2dac5f2de628)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:42.781034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:42.889688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7c1a42642c4a67ab6e2dac5f2de628', 'request_id': 'req-12e27812-081a-4e44-ab5e-d5dfd2313924'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.899294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7c1a42642c4a67ab6e2dac5f2de628', 'request_id': 'req-12e27812-081a-4e44-ab5e-d5dfd2313924'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.911319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7c1a42642c4a67ab6e2dac5f2de628', 'request_id': 'req-12e27812-081a-4e44-ab5e-d5dfd2313924'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.935420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] The token cache is being invalidate because project 0f7c1a42642c4a67ab6e2dac5f2de628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:42.935723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.936532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:42.938387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 978/1963] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:42 2021] DELETE /identity/v3/projects/0f7c1a42642c4a67ab6e2dac5f2de628 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:42.944027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:42.959747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9adb4-8754-4ead-9e51-cf32510f0a49 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:43.058121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:43.060024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:43.060848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:43.061599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] PATH_INFO: `/v3/users/086b94da3c5143e29c0a4eba35734d27` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:43.064366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086b94da3c5143e29c0a4eba35734d27)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:43.068380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:43.196079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086b94da3c5143e29c0a4eba35734d27'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.197948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086b94da3c5143e29c0a4eba35734d27'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.227463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:43.229020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086b94da3c5143e29c0a4eba35734d27'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.231136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:43.251715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e27812-081a-4e44-ab5e-d5dfd2313924 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:43.260789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:43.262057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:43.262412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:43.262696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] PATH_INFO: `/v3/projects/805e86771754450ba72684e0d2fc7d3b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:43.264887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] RBAC: Authorizing `identity:delete_project(project_id=805e86771754450ba72684e0d2fc7d3b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:43.267538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:43.290441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086b94da3c5143e29c0a4eba35734d27'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.312394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086b94da3c5143e29c0a4eba35734d27'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.336148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 986/1964] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:42 2021] DELETE /identity/v3/users/086b94da3c5143e29c0a4eba35734d27 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:43.402085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805e86771754450ba72684e0d2fc7d3b', 'request_id': 'req-872e6ee3-9064-4698-acfb-6b6d5dc4423b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.414708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805e86771754450ba72684e0d2fc7d3b', 'request_id': 'req-872e6ee3-9064-4698-acfb-6b6d5dc4423b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.445086 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805e86771754450ba72684e0d2fc7d3b', 'request_id': 'req-872e6ee3-9064-4698-acfb-6b6d5dc4423b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.490299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] The token cache is being invalidate because project 805e86771754450ba72684e0d2fc7d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:43.491448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.495404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:43.503096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 979/1965] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:43 2021] DELETE /identity/v3/projects/805e86771754450ba72684e0d2fc7d3b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:43.510398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:43.514870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:43.714060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072254e-a5a0-48b7-ba4d-176d117b21a9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:43.934928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:43.935958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:43.936845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:43.936845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] PATH_INFO: `/v3/users/76cee67ad6e0422aabcbc33abe461ba5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:43.938430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76cee67ad6e0422aabcbc33abe461ba5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:43.944089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.069541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76cee67ad6e0422aabcbc33abe461ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.070736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76cee67ad6e0422aabcbc33abe461ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.091573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76cee67ad6e0422aabcbc33abe461ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.123620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76cee67ad6e0422aabcbc33abe461ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.131536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.137178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-daf6ecd3-c45a-4f5d-a08c-9c1bf724a693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76cee67ad6e0422aabcbc33abe461ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.139023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.150287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 987/1966] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:43 2021] DELETE /identity/v3/users/76cee67ad6e0422aabcbc33abe461ba5 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:44.167883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ee3-9064-4698-acfb-6b6d5dc4423b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.263110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.264110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.264462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.264765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] PATH_INFO: `/v3/projects/2a29e6fe61f644bfb53c40ea790e0755` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.266320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a29e6fe61f644bfb53c40ea790e0755)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.269776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.342690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a29e6fe61f644bfb53c40ea790e0755', 'request_id': 'req-28be28c3-23bd-454f-a97c-b324240b4105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.355534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a29e6fe61f644bfb53c40ea790e0755', 'request_id': 'req-28be28c3-23bd-454f-a97c-b324240b4105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.368230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a29e6fe61f644bfb53c40ea790e0755', 'request_id': 'req-28be28c3-23bd-454f-a97c-b324240b4105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.388708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] The token cache is being invalidate because project 2a29e6fe61f644bfb53c40ea790e0755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:44.389219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.390524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28be28c3-23bd-454f-a97c-b324240b4105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.393979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 980/1967] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:44 2021] DELETE /identity/v3/projects/2a29e6fe61f644bfb53c40ea790e0755 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:44.400197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.400720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.401083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.428207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:44.429736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.519237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 988/1968] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:44.522536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.523224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.523752 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.551529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:44.553429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.562863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 981/1969] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:44.568870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.576922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.578910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.590909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63304ae-877f-4d7d-aa93-b18d1b4826e8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.593414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7ff3-e58d-4070-9e76-eef48671b161 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.600360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.601498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.601631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.602035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.602528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.603186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.604016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.604288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:44.604713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] PATH_INFO: `/v3/projects/c0dd18d02a7543caa0883687b0579193` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.604903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.606471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dd18d02a7543caa0883687b0579193)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.608027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.608634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.631356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 989/1970] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:44.637162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.648492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0ae67-ccbc-4e92-8389-a844f487f243 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.654178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.655003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.655283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.655557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.656341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.658605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.669609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dd18d02a7543caa0883687b0579193', 'request_id': 'req-b249ab5e-6b2b-4394-9baa-18d06b986c57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.676270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dd18d02a7543caa0883687b0579193', 'request_id': 'req-b249ab5e-6b2b-4394-9baa-18d06b986c57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.684360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dd18d02a7543caa0883687b0579193', 'request_id': 'req-b249ab5e-6b2b-4394-9baa-18d06b986c57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.698516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 990/1971] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/projects => generated 407 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:44.700008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.704706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] The token cache is being invalidate because project c0dd18d02a7543caa0883687b0579193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:44.705180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.706193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b249ab5e-6b2b-4394-9baa-18d06b986c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:44.708670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 982/1972] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:44 2021] DELETE /identity/v3/projects/c0dd18d02a7543caa0883687b0579193 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:44.714858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216c0e-8c07-4e43-a9c9-a0edb1d631f3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.715256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216c0e-8c07-4e43-a9c9-a0edb1d631f3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.715605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216c0e-8c07-4e43-a9c9-a0edb1d631f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.738534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-be216c0e-8c07-4e43-a9c9-a0edb1d631f3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:44.740076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-be216c0e-8c07-4e43-a9c9-a0edb1d631f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.806902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b15a-6e26-4c75-8c9f-e5c3cf8914dd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.810898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 983/1973] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:44.815861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.816834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.817282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.817646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.818622 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.820826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.821113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.821301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.821449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.844354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:44.846549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.855474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 991/1974] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/users => generated 304 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:44.857797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.859858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:44.862129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 984/1975] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:44.871915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.880519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941ac1-364b-490b-88a2-151db55173cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.888793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.890046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.890513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.890976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.892880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.893908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd83de-8037-448d-a4a4-23e11874c0c9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.896999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.902033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.903305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.903787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.904241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.905662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:44.906178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.909608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.920489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 992/1976] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:44 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:44.922793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.938832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95a47-fc88-4ae9-9b03-46d0b78846b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.940978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 985/1977] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:21:44.945952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:44.950046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.951544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.953658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.954447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.955990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.958329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.963840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c09d-c31f-4806-8015-ba4c3dab02dd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:44.972173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:44.973292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:44.973753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:44.974193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:44.975483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:44.975934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 993/1978] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:44 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:44.981486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:44.983047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.009506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbb74-2ab7-4006-ae3c-79adb7c8d2ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.026401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.030066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.030345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.030631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] PATH_INFO: `/v3/projects/845090117ecb4ee6af8749e87a667ddb/users/3a2f5f419c8b4818a1c2a770af96d2c3/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.038993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 986/1979] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:44 2021] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:45.045484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.107323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845090117ecb4ee6af8749e87a667ddb, user_id=3a2f5f419c8b4818a1c2a770af96d2c3, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.114182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bef922-295d-46c8-b922-3b2495ddd600 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.179946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d6c37-0021-48fd-a6e7-a13b02c11158 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.202945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 994/1980] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:44 2021] PUT /identity/v3/projects/845090117ecb4ee6af8749e87a667ddb/users/3a2f5f419c8b4818a1c2a770af96d2c3/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:45.210465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.211256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.211773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.286165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] MFA Rules not processed for user `3a2f5f419c8b4818a1c2a770af96d2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:45.289134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:45.319711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.320827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.322101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.322232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.323402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.326741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.372641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 987/1981] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:45.376619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.391856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ab78d-370f-41cb-bea4-1f7da00d3cae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.399199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.399949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.400471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.401060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.401961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.403666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.417325 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 988/1982] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:45.421304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.433328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1e084-2be7-4180-9f7a-83d4f1c40874 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.438857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.439716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.440013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.440284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.441116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.442842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.455316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 989/1983] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:45.458835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 995/1984] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:45.459673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.465019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.475083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015112-c5a0-45ad-b8e6-fd78c58bd4b8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.487619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.492720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9237cdf-f2f3-4ed4-bcd1-d4ebbff9e31f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.492871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.492871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.492871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] PATH_INFO: `/v3/projects/4dddccb5e6d642da9d2cec44e8c93227/users/73910910257348c7903d08729d2b01c8/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.505652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.506806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.507399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.507962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.509092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.511756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.514431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dddccb5e6d642da9d2cec44e8c93227, user_id=73910910257348c7903d08729d2b01c8, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.517568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2db9fe-4145-4edb-b529-88e0a689cb10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.534398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 990/1985] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:45 2021] PUT /identity/v3/projects/4dddccb5e6d642da9d2cec44e8c93227/users/73910910257348c7903d08729d2b01c8/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:45.545464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.545670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.546295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.571655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 996/1986] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:45.573944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.575711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] MFA Rules not processed for user `73910910257348c7903d08729d2b01c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:45.577098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:45.662631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447cb24-025b-4bf1-96e9-3e82cafdea9a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.667881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.668631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.668909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.669179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.669883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.671813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.678162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 991/1987] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:45.683368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.698849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 997/1988] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/users => generated 310 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:45.703545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.703736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a17eb-e69c-4e25-ad5b-c7af09f9b1d8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.713489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.714750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.715248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.715754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.716655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.720662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.723262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e440e7-85cd-40ad-8142-f3aefe0660e7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.734018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.735021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.735415 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.736291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.736653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.738365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.756868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 998/1989] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:45 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:45.761245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.776589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 992/1990] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:45.777800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.781309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bba8a-bbd5-49ce-bfd1-302cec813985 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.865952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35e2-69b3-4456-befc-39d39f84a053 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.871588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.872308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.872686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.872889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.873644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.875629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.902100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 993/1991] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:45 2021] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:45.903330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.905065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.905662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.906231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] PATH_INFO: `/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922/users/256faa4f966e41b8ba7b98702102a720/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.906396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.918075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b691-4403-4e4c-ba1e-07e5fa6f4533 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.924560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.925275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.925579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.926622 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.926786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.928448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.938721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c69ef6ef9440ddb1ac0f9945aee922, user_id=256faa4f966e41b8ba7b98702102a720, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:45.945227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 994/1992] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:45 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:45.946239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.953069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:45.961026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3551f7-2c9e-4050-b3b0-f7c624902c21 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:45.969462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:45.972212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:45.972809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:45.973577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] PATH_INFO: `/v3/projects/298ebb15b1964d4aa56e4911caecb5e8/users/5362b080e1194fe887be49172fe46ce0/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:45.977008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 999/1993] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:45 2021] PUT /identity/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922/users/256faa4f966e41b8ba7b98702102a720/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:45.983885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:45.999009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=298ebb15b1964d4aa56e4911caecb5e8, user_id=5362b080e1194fe887be49172fe46ce0, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.010371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.029798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 995/1994] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:45 2021] PUT /identity/v3/projects/298ebb15b1964d4aa56e4911caecb5e8/users/5362b080e1194fe887be49172fe46ce0/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:46.034095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:46.092730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a930-b8e6-443e-9c61-815285a7d641 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.147698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca78b-e79a-4e9c-807e-99d6b2f14e8d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.153802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.153802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.153997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.154195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.154974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.156636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.168588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 996/1995] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:46 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:46.173097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:46.176238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.177078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.177448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.177793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.178651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.180297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.184343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeb6e4-1128-45e3-b2bc-cef8a9a8b1e5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.191347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.191873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1000/1996] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:45 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:46.192724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.193222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.193635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] PATH_INFO: `/v3/projects/298ebb15b1964d4aa56e4911caecb5e8/users/5362b080e1194fe887be49172fe46ce0/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.196204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298ebb15b1964d4aa56e4911caecb5e8, user_id=5362b080e1194fe887be49172fe46ce0, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.197276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:46.199110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8d320-aebc-4125-beae-942595deb9e3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.215421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 997/1997] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:46 2021] PUT /identity/v3/projects/298ebb15b1964d4aa56e4911caecb5e8/users/5362b080e1194fe887be49172fe46ce0/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:46.217976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89235a18-87e6-4b7f-8d9d-b878450de0c9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.231852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.231852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.231852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.273837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] MFA Rules not processed for user `5362b080e1194fe887be49172fe46ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:46.275365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:46.372956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.373935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.374464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.374615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] PATH_INFO: `/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922/users/256faa4f966e41b8ba7b98702102a720/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.379219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c69ef6ef9440ddb1ac0f9945aee922, user_id=256faa4f966e41b8ba7b98702102a720, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.381998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622344b1-6c65-4bfb-b89f-9c215b0c34cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.398135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1001/1998] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:46 2021] PUT /identity/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922/users/256faa4f966e41b8ba7b98702102a720/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:46.416977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.417260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.417508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.423813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 998/1999] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:46 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:46.450929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] MFA Rules not processed for user `256faa4f966e41b8ba7b98702102a720`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:46.452356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:46.486299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:46.487939 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:46.576669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1002/2000] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:46 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:46.576905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67f8d9-d16c-4563-8346-8905e22e9d97 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.656137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.658638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.659036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.659611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.751225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.754642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.772634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 999/2001] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:46 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:46.787917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:46.789691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:46.805496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491a39-cb6c-4cef-bb6f-a98ba6f0d9c3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:46.810350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:46.811148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:46.811607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:46.812014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:46.835816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:46.837360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:46.849071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1003/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:46 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:21:47.064252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:47.075015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d16ed-6411-41cf-bdf8-1b763faaad1b service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:47.081327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:47.082651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:47.083153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:47.083710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:47.166228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:47.167786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37831-dd22-439d-8ce4-03fd297fcb2a service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:47.179033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1000/2003] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:47 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:47.460100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:47.616725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a006b4-c7a2-44b2-8311-eb5347c47a53 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:47.628731 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:47.629885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:47.630393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:47.631405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] PATH_INFO: `/v3/users/73910910257348c7903d08729d2b01c8` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:47.634987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73910910257348c7903d08729d2b01c8)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:47.639854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:47.710778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73910910257348c7903d08729d2b01c8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:47.713015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73910910257348c7903d08729d2b01c8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:47.724619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73910910257348c7903d08729d2b01c8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:47.746293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73910910257348c7903d08729d2b01c8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:47.759278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73910910257348c7903d08729d2b01c8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:47.768638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1004/2004] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:47 2021] DELETE /identity/v3/users/73910910257348c7903d08729d2b01c8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:47.773968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:47.774559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:47.774827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:47.796655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:47.797895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:47.883900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1001/2005] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:47.898708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:47.902294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:47.992287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a12b93-56a1-46f2-8a64-3227103cd589 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:47.997981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:47.998748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:47.999089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:47.999488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:48.016373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:48.019326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:48.037837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1005/2006] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:48.386177 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:48.387837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:48.401263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a63c8-a1dc-4bdc-b293-2f40eafac2ea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:48.409169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:48.410228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:48.410530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:48.410777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] PATH_INFO: `/v3/projects/4dddccb5e6d642da9d2cec44e8c93227` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:48.417784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dddccb5e6d642da9d2cec44e8c93227)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:48.420951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:48.481961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dddccb5e6d642da9d2cec44e8c93227', 'request_id': 'req-2278d0de-e13e-4483-ac32-e08cdfd0d893'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.489957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dddccb5e6d642da9d2cec44e8c93227', 'request_id': 'req-2278d0de-e13e-4483-ac32-e08cdfd0d893'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.498495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dddccb5e6d642da9d2cec44e8c93227', 'request_id': 'req-2278d0de-e13e-4483-ac32-e08cdfd0d893'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.515344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] The token cache is being invalidate because project 4dddccb5e6d642da9d2cec44e8c93227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:48.515344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.516004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.518337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1002/2007] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:48 2021] DELETE /identity/v3/projects/4dddccb5e6d642da9d2cec44e8c93227 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:48.522776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:48.534930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12af9-1eff-40cc-8924-c5e1041817d7 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:48.618961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:48.619849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:48.620245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:48.620546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] PATH_INFO: `/v3/users/5362b080e1194fe887be49172fe46ce0` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:48.621822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5362b080e1194fe887be49172fe46ce0)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:48.623733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:48.683338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5362b080e1194fe887be49172fe46ce0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.684377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5362b080e1194fe887be49172fe46ce0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.698509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5362b080e1194fe887be49172fe46ce0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.712717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5362b080e1194fe887be49172fe46ce0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.722529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-333086dd-2f50-408d-8ecc-d6e7cbd713d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5362b080e1194fe887be49172fe46ce0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:48.730234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1006/2008] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:48 2021] DELETE /identity/v3/users/5362b080e1194fe887be49172fe46ce0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:49.059361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.061303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:49.084476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d0de-e13e-4483-ac32-e08cdfd0d893 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.199931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.202796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.203304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.203803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] PATH_INFO: `/v3/projects/298ebb15b1964d4aa56e4911caecb5e8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.206261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=298ebb15b1964d4aa56e4911caecb5e8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.210024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.302369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298ebb15b1964d4aa56e4911caecb5e8', 'request_id': 'req-47374fd7-30dd-46fc-9601-eec47d49a42f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:49.308791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298ebb15b1964d4aa56e4911caecb5e8', 'request_id': 'req-47374fd7-30dd-46fc-9601-eec47d49a42f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:49.316113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298ebb15b1964d4aa56e4911caecb5e8', 'request_id': 'req-47374fd7-30dd-46fc-9601-eec47d49a42f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:49.335808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] The token cache is being invalidate because project 298ebb15b1964d4aa56e4911caecb5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:49.336793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:49.338706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-47374fd7-30dd-46fc-9601-eec47d49a42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:49.341931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1003/2009] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:49 2021] DELETE /identity/v3/projects/298ebb15b1964d4aa56e4911caecb5e8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:49.352164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.354042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.354483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.387342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:49.389459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:49.467052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1007/2010] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:49.476830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.477182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.477513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.498628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:49.499878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:49.510232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1004/2011] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:49.515332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.526784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe9ac-d455-4a33-93fa-e52f8b7e5f4c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.531985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.532841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.533321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.533684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.534538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:49.534853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.536566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.550722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1008/2012] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:49.555586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.566424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977ac02-cdbf-426e-a7c6-ecea65a62fb0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.572119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.572735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.573022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.573296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.574062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.576202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.611330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1005/2013] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:49 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:49.618102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.635806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ee2fa-0f86-413a-bbe4-5fb0c4dbfb64 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.734847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.736138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.736695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.737392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.739270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.743631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.777820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1009/2014] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:49 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:49.782957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.795406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d923-1ffe-46ff-ba24-a7153dee99e7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.802066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.802919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.803206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.803483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.804256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.806349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.820723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1006/2015] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:49 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:49.825054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.837235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068bdb-6632-4910-a074-0f165e0fa7ca admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.843224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.844136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.844557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.844922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.846316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.847619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448fbb7-9a2e-4617-a627-67a90d343df8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.859871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1010/2016] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:49.864573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:49.875698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd67a6-4ef9-4150-8c4a-53eae8f3af08 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:49.881599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:49.882506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.882791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.883073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] PATH_INFO: `/v3/projects/7a49da1badd04bcbb2a740af612fa7cb/users/6bcbaed9bce642d89b1ed3efd28bd980/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.900695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a49da1badd04bcbb2a740af612fa7cb, user_id=6bcbaed9bce642d89b1ed3efd28bd980, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.903947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.921921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1007/2017] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:49 2021] PUT /identity/v3/projects/7a49da1badd04bcbb2a740af612fa7cb/users/6bcbaed9bce642d89b1ed3efd28bd980/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:49.933549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:49.933821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:49.934148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.966100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] MFA Rules not processed for user `6bcbaed9bce642d89b1ed3efd28bd980`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:49.967701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:50.050303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1011/2018] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:49 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:50.066290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:50.068579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:50.136361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a9a4-3094-4a6a-a05f-71b40bfbdfd8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:50.140654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:50.141327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:50.141604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:50.141870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:50.151556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:50.153152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f150c7-a696-4df6-92a1-c93372b916af service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:50.163855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1008/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:50 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:50.184266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:50.256315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d29e7d-684c-40e8-b42e-89b99a55a01f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:50.262164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:50.263120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:50.263120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:50.263450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] PATH_INFO: `/v3/users/6bcbaed9bce642d89b1ed3efd28bd980` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:50.264789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bcbaed9bce642d89b1ed3efd28bd980)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:50.266755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:50.324534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bcbaed9bce642d89b1ed3efd28bd980'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:50.325080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bcbaed9bce642d89b1ed3efd28bd980'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:50.333437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bcbaed9bce642d89b1ed3efd28bd980'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:50.347878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bcbaed9bce642d89b1ed3efd28bd980'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:50.356451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bcbaed9bce642d89b1ed3efd28bd980'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:50.362800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1012/2020] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:50 2021] DELETE /identity/v3/users/6bcbaed9bce642d89b1ed3efd28bd980 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:50.367735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:50.368012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:50.368289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:50.387183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:50.388660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:50.460387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1009/2021] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:50.471065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:50.473489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:50.533639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f7b5-5a64-4d77-a49c-10e06e4f63cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:50.538347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:50.539010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:50.539282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:50.539552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:50.549771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:50.551218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570623c2-696f-4a81-bac0-d7115419a295 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:50.561616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1013/2022] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:50.876725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:50.878516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:50.908964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e43f5-37e2-4e47-a291-3d154c12dd04 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:50.915518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:50.916819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:50.918537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:50.918889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] PATH_INFO: `/v3/projects/7a49da1badd04bcbb2a740af612fa7cb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:50.920365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a49da1badd04bcbb2a740af612fa7cb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:50.922441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:50.994466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a49da1badd04bcbb2a740af612fa7cb', 'request_id': 'req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:51.008878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a49da1badd04bcbb2a740af612fa7cb', 'request_id': 'req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:51.020221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a49da1badd04bcbb2a740af612fa7cb', 'request_id': 'req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:51.037520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] The token cache is being invalidate because project 7a49da1badd04bcbb2a740af612fa7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:51.037834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:51.038488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-19c13df4-1ac6-40a8-848a-0cf11d3c59f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:51.040896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1010/2023] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:50 2021] DELETE /identity/v3/projects/7a49da1badd04bcbb2a740af612fa7cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:21:51.048055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.050050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.050050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.070653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:51.071913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:51.146585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1014/2024] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:51.157059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.157640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.158115 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.179108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:51.180534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:51.189487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1011/2025] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:51.193557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.204162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0bb4-f784-4e7c-87fe-bd75afa5222e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.209552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.210479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.210764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.211030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.211779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:21:51.212078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.213727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.227268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1015/2026] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:21:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:21:51.232217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.242710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd950-4ba5-4e1a-8aac-a4d88a085850 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.247747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.248479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.248764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.249038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.249919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.251920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.282866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1012/2027] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:21:51 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:21:51.287834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.298893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b90-46f3-4bc8-beae-088117838c05 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.373723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.374805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.375183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.375698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.377266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.379570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.404652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1016/2028] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:21:51 2021] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:21:51.413921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.426663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029764a7-1e63-4ab1-8c0f-2940a6bc95fc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.431560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.432407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.432725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.433141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.433772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.435402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.449140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1013/2029] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:51 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:21:51.453385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.463844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df728c-1411-4269-9c2c-b1e530059136 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.468826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.469512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.469791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.470040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.470835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.472468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db15354-cf13-475b-b8b4-790af66a8f70 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.483932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1017/2030] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:21:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:21:51.488932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.500130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaeb27-f98a-438b-a720-b73d814be195 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.506220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.507337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.507686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.507984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] PATH_INFO: `/v3/projects/ac9d5f3f67a44b73acf33063403c2c88/users/2148d1cf990047d8b7963cd7c33a6a24/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.525922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9d5f3f67a44b73acf33063403c2c88, user_id=2148d1cf990047d8b7963cd7c33a6a24, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.528665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.545859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1014/2031] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:21:51 2021] PUT /identity/v3/projects/ac9d5f3f67a44b73acf33063403c2c88/users/2148d1cf990047d8b7963cd7c33a6a24/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:51.557192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.558136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.558641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.589137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] MFA Rules not processed for user `2148d1cf990047d8b7963cd7c33a6a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:51.590394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:51.677828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1018/2032] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:51.693527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:51.695868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:51.772669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3d476-7e47-4517-8226-5b35b58e0c90 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:51.776660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:51.777333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:51.777612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:51.778063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:51.788550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:51.790033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3642474-93f9-4699-b024-9b4a4e9293ff service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:51.802676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1015/2033] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:21:59.533469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:59.535199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:59.613507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e5b3-16d2-49aa-a8a8-132c7ef9d127 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:59.618475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:59.619371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:59.619646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:59.619918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] PATH_INFO: `/v3/users/0f773eee993048b08e43d182c1dec425` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:59.621223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f773eee993048b08e43d182c1dec425)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:59.623209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:59.692683 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f773eee993048b08e43d182c1dec425'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:59.693749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f773eee993048b08e43d182c1dec425'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:59.703639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f773eee993048b08e43d182c1dec425'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:59.721238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f773eee993048b08e43d182c1dec425'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:59.730303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f773eee993048b08e43d182c1dec425'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:59.737472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1019/2034] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:59 2021] DELETE /identity/v3/users/0f773eee993048b08e43d182c1dec425 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:59.742385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:59.743009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:59.743009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:59.762434 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:21:59.763678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:59.840071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1016/2035] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:21:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:21:59.851252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:59.852855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:59.928113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533483c-2931-4ea2-a45b-6fa04fb5a31c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:59.932643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:59.933407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:59.933776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:59.934101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:59.945664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:59.947358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:59.961715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1020/2036] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:00.277082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:00.279328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:00.295775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906768-9b4d-4a9c-87d0-621a40acf0a1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:00.306640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:00.307870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:00.308226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:00.309235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] PATH_INFO: `/v3/projects/ad9c32935418493d9f0fe633a8209840` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:00.311577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9c32935418493d9f0fe633a8209840)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:00.316609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:00.391892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9c32935418493d9f0fe633a8209840', 'request_id': 'req-f3766dd6-e7af-48c1-9954-da73bea5f69f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.400288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9c32935418493d9f0fe633a8209840', 'request_id': 'req-f3766dd6-e7af-48c1-9954-da73bea5f69f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.408003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9c32935418493d9f0fe633a8209840', 'request_id': 'req-f3766dd6-e7af-48c1-9954-da73bea5f69f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.427745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] The token cache is being invalidate because project ad9c32935418493d9f0fe633a8209840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:00.428188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.429060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.430831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1017/2037] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:00 2021] DELETE /identity/v3/projects/ad9c32935418493d9f0fe633a8209840 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:00.435833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:00.446368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4484ba0-b56e-4071-b9af-5bba4276d759 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:00.517176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:00.518628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:00.518943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:00.519386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] PATH_INFO: `/v3/users/e7f33f0f45dc4ebfa5b8e37adca4f900` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:00.521579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f33f0f45dc4ebfa5b8e37adca4f900)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:00.525035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:00.592017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f33f0f45dc4ebfa5b8e37adca4f900'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.592829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f33f0f45dc4ebfa5b8e37adca4f900'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.601640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f33f0f45dc4ebfa5b8e37adca4f900'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.617027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f33f0f45dc4ebfa5b8e37adca4f900'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.625713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e75a5e0f-f2d6-400d-aae3-70ad18062917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f33f0f45dc4ebfa5b8e37adca4f900'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:00.632344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1021/2038] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:00 2021] DELETE /identity/v3/users/e7f33f0f45dc4ebfa5b8e37adca4f900 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:01.026224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.028778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:01.045157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766dd6-e7af-48c1-9954-da73bea5f69f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.119412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.120534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.120876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.121208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] PATH_INFO: `/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.122863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28ab67e198642cd805c9c5b4fe8a1b7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.125560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.176594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28ab67e198642cd805c9c5b4fe8a1b7', 'request_id': 'req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:01.182727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28ab67e198642cd805c9c5b4fe8a1b7', 'request_id': 'req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:01.189634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28ab67e198642cd805c9c5b4fe8a1b7', 'request_id': 'req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:01.203529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] The token cache is being invalidate because project f28ab67e198642cd805c9c5b4fe8a1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:01.203791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:01.204494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0d9a9f22-ea82-4a7c-a72c-f50724a15e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:01.206370 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1018/2039] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:01 2021] DELETE /identity/v3/projects/f28ab67e198642cd805c9c5b4fe8a1b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:01.212513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.212850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.213286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.240085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:01.241931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:01.328923 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1022/2040] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:01.340054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.340296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.340650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.368741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:01.370776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:01.387291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1019/2041] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:01.392156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.403420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467f8f-8c14-4e97-9b29-7ece6bd2f4bc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.408756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.409451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.409809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.410081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.410823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:01.411122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.412807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.426138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1023/2042] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:01.430938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.441056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063818-47f4-429f-8ac4-cc274c74297a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.446869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.447665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.448025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.448358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.449245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.451430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.478623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1020/2043] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:01.483348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.493910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e09c-0b3a-4838-ae46-5ecaab5ab7be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.554561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.556819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.556819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.556819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.557979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.560272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.585445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1024/2044] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:01.589959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.602010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f969-3630-48e8-b84a-1180b041bee7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.607944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.608962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.609432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.609716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.610617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.612603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.632702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1021/2045] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:01.637096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.648288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b6174-21b7-4c5f-8588-fe6df166e8de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.656660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.657351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.657625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.657925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.658856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.660554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7746-811c-4b93-a04d-a34398aaa1f2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.671944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1025/2046] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:01.676639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.687473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963006db-04d1-4bdd-bfb1-c072f999e006 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.693197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.694181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.694456 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.694725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] PATH_INFO: `/v3/projects/d57fbcb444734dd38b120c846774cff9/users/6d3164c0853e401880c32a50cdc8be53/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.713098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57fbcb444734dd38b120c846774cff9, user_id=6d3164c0853e401880c32a50cdc8be53, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.715822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.736636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1022/2047] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:01 2021] PUT /identity/v3/projects/d57fbcb444734dd38b120c846774cff9/users/6d3164c0853e401880c32a50cdc8be53/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:01.747662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.747953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.748232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.787125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] MFA Rules not processed for user `6d3164c0853e401880c32a50cdc8be53`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:01.789310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:01.869202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1026/2048] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:01.875269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:01.954235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3c11-dbb5-4c0c-b60c-b46b0828d4a0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:01.959637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:01.960344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:01.960658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:01.960936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:01.961672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:01.963613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:01.994152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1023/2049] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:01.998825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.015615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d3de-9786-4a2c-acbb-d3bc86fc5ee9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.109988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.110692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.110964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.111404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.112280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.114372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.138259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1027/2050] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:01 2021] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:02.143261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.156359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12161e30-c7cd-44e8-a4ea-fe03fef5c7b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.163608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.164677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.164957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.165228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.165996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.167635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.179967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1024/2051] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:02.185676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.208054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3200-ea9b-4f59-9205-b169b6bdf12c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.219583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.220794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.221265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.222240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.223561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.226625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f406a-e1ef-4b13-86d0-e24ca4a4abf5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.240650 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1028/2052] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:02.249316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.264057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7545c-7c23-403c-8090-f01abf342334 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.272156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.273097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.273379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.273662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] PATH_INFO: `/v3/projects/e4617392279d4cfda771abf386dbede4/users/ad43d92ab74f4fe19b4175c0247a8148/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.292060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4617392279d4cfda771abf386dbede4, user_id=ad43d92ab74f4fe19b4175c0247a8148, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.294787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.311908 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1025/2053] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:02 2021] PUT /identity/v3/projects/e4617392279d4cfda771abf386dbede4/users/ad43d92ab74f4fe19b4175c0247a8148/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:02.325066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.325660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.326119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.358782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] MFA Rules not processed for user `ad43d92ab74f4fe19b4175c0247a8148`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:02.360103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:02.434165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1029/2054] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:02.438921 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.529972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34398-a13c-4e10-89a2-1c52d47ce70d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.535923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.537136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.537347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.537768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.538758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.540672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.584339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1026/2055] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:02 2021] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:02.588891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.608023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86e0f9-b54c-491c-8b7f-fe323cd73c78 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.696784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.697575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.698030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.698347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.699184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.701789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.727753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1030/2056] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:02 2021] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:02.732727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.762390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6818-821e-444c-9cc3-117c94639e96 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.768093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.768861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.769442 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.769749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.770524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.772247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.789019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1027/2057] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:02.792779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.809387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098208f9-b95b-4ed6-bab6-835f08845e7a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.815647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.816624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.816905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.817192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] PATH_INFO: `/v3/projects/f43619f1944b4611ae538a51789743d9/users/eeabbee407c446f19f47bbbbae6f1459/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.836342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43619f1944b4611ae538a51789743d9, user_id=eeabbee407c446f19f47bbbbae6f1459, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.839842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.862462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1031/2058] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:02 2021] PUT /identity/v3/projects/f43619f1944b4611ae538a51789743d9/users/eeabbee407c446f19f47bbbbae6f1459/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:02.869187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.880950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7a44-d3ee-46cd-b787-e2187ac7b5f1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:02.949539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:02.950661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:02.950988 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:02.951746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:02.951998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:02.953819 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f8e01-7ff9-4425-bc21-9e7f753af549 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:02.971970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:02.992578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1028/2059] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:02 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:02.996718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03212-70cf-4d41-901b-ba7a504d5b12 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:03.010173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:03.011485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:03.011850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:03.012189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] PATH_INFO: `/v3/projects/f43619f1944b4611ae538a51789743d9/users/eeabbee407c446f19f47bbbbae6f1459/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:03.014788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43619f1944b4611ae538a51789743d9, user_id=eeabbee407c446f19f47bbbbae6f1459, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:03.018582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:03.040082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1032/2060] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:02 2021] PUT /identity/v3/projects/f43619f1944b4611ae538a51789743d9/users/eeabbee407c446f19f47bbbbae6f1459/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:03.052479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:03.053368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:03.053368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:03.083555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] MFA Rules not processed for user `eeabbee407c446f19f47bbbbae6f1459`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:03.085166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:03.162799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1029/2061] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:03 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:03.174135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:03.176373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:03.253128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2d2e-75cc-44fa-8b21-b7240b684f3d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:03.265458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:03.269973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:03.269973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:03.269973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:03.362065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:03.363710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:03.375419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1033/2062] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:03 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:05.198023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:05.215361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee916246-f090-4863-a5bd-a1152f820cfc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:05.222003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:05.223124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:05.223606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:05.224106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:05.339194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:05.340716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:05.351029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1030/2063] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:07.714000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:07.723285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c44c1-88b2-445d-97f5-b7c9d681b945 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:07.727297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:07.727947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:07.728220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:07.728514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:07.739266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:07.740729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc83e0d-ce98-48a4-a848-4edecaded5a0 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:07.750772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1034/2064] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:07 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:09.799714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:09.801494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:09.868753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af170f7-7681-4839-9954-ba895b9703bb service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:09.873346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:09.874235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:09.874512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:09.874785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] PATH_INFO: `/v3/users/3a2f5f419c8b4818a1c2a770af96d2c3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:09.876106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2f5f419c8b4818a1c2a770af96d2c3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:09.878579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:09.932750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2f5f419c8b4818a1c2a770af96d2c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:09.949398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2f5f419c8b4818a1c2a770af96d2c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:09.957679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2f5f419c8b4818a1c2a770af96d2c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:09.965455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2f5f419c8b4818a1c2a770af96d2c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:09.966157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2f5f419c8b4818a1c2a770af96d2c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:09.975701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1031/2065] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:09 2021] DELETE /identity/v3/users/3a2f5f419c8b4818a1c2a770af96d2c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:09.980477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:09.980957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:09.981050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:10.005088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:10.006642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:10.086749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1035/2066] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:10.102667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:10.105462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:10.183232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01985-cb01-4497-9953-23275d94546e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:10.186856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:10.187516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:10.187820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:10.188091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:10.198030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:10.199505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:10.210989 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1032/2067] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:10.827453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:10.829710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:10.848677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436acf-76af-4f10-a822-85b71c7e1b13 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:10.852713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:10.853795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:10.854597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:10.855413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] PATH_INFO: `/v3/projects/845090117ecb4ee6af8749e87a667ddb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:10.857050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] RBAC: Authorizing `identity:delete_project(project_id=845090117ecb4ee6af8749e87a667ddb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:10.861590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:10.931790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845090117ecb4ee6af8749e87a667ddb', 'request_id': 'req-c8186e80-f7b4-435d-9735-e7383622776d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:10.940333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845090117ecb4ee6af8749e87a667ddb', 'request_id': 'req-c8186e80-f7b4-435d-9735-e7383622776d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:10.949310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845090117ecb4ee6af8749e87a667ddb', 'request_id': 'req-c8186e80-f7b4-435d-9735-e7383622776d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:10.968550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] The token cache is being invalidate because project 845090117ecb4ee6af8749e87a667ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:10.968953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:10.969865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:10.971962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1036/2068] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:10 2021] DELETE /identity/v3/projects/845090117ecb4ee6af8749e87a667ddb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:10.977247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:10.988157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dba86-cc15-4645-a063-79d1b330fabc service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:11.053981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:11.054933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.055226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.055526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] PATH_INFO: `/v3/users/256faa4f966e41b8ba7b98702102a720` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.056852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=256faa4f966e41b8ba7b98702102a720)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:11.058848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:11.072607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:11.075388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.093852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186e80-f7b4-435d-9735-e7383622776d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:11.100867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:11.102049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.102491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.102915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] PATH_INFO: `/v3/users/7221014c51874578aaaf6f78e5327d70` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.105031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7221014c51874578aaaf6f78e5327d70)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:11.107139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:11.119077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256faa4f966e41b8ba7b98702102a720'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.138537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256faa4f966e41b8ba7b98702102a720'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.148465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256faa4f966e41b8ba7b98702102a720'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.160187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256faa4f966e41b8ba7b98702102a720'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.161037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256faa4f966e41b8ba7b98702102a720'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.161727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7221014c51874578aaaf6f78e5327d70'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.162579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7221014c51874578aaaf6f78e5327d70'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.167866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1033/2069] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:10 2021] DELETE /identity/v3/users/256faa4f966e41b8ba7b98702102a720 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:11.170854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7221014c51874578aaaf6f78e5327d70'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.198850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7221014c51874578aaaf6f78e5327d70'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.202877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7221014c51874578aaaf6f78e5327d70'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.215145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1037/2070] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:11 2021] DELETE /identity/v3/users/7221014c51874578aaaf6f78e5327d70 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:11.483584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:11.487702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.567390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:11.569205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.601548 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d7d7-5ad4-4d98-8cd6-f4ea6e18b57e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:11.695012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83a73-22c3-489a-b2dd-bc5dab978769 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:11.700570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:11.701660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.702052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.702440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] PATH_INFO: `/v3/projects/0d66ed76bcb74b45acc60dc6a0c965f1` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.703897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d66ed76bcb74b45acc60dc6a0c965f1)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:11.706454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:11.706673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:11.708661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.709185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.709880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] PATH_INFO: `/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.712548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c69ef6ef9440ddb1ac0f9945aee922)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:11.718082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:11.773775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d66ed76bcb74b45acc60dc6a0c965f1', 'request_id': 'req-aa8c263a-999a-4546-aa80-65d01488081a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.792394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d66ed76bcb74b45acc60dc6a0c965f1', 'request_id': 'req-aa8c263a-999a-4546-aa80-65d01488081a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.804409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d66ed76bcb74b45acc60dc6a0c965f1', 'request_id': 'req-aa8c263a-999a-4546-aa80-65d01488081a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.822896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] The token cache is being invalidate because project 0d66ed76bcb74b45acc60dc6a0c965f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:11.823187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.823837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-aa8c263a-999a-4546-aa80-65d01488081a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.827538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1034/2071] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:11 2021] DELETE /identity/v3/projects/0d66ed76bcb74b45acc60dc6a0c965f1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:11.835229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ac1e-4c0c-40b0-aef4-1f103a1021eb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.835552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ac1e-4c0c-40b0-aef4-1f103a1021eb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.835864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ac1e-4c0c-40b0-aef4-1f103a1021eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.838301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c69ef6ef9440ddb1ac0f9945aee922', 'request_id': 'req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.861977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c69ef6ef9440ddb1ac0f9945aee922', 'request_id': 'req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.873004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-eaf5ac1e-4c0c-40b0-aef4-1f103a1021eb None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:11.874703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-eaf5ac1e-4c0c-40b0-aef4-1f103a1021eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.877488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c69ef6ef9440ddb1ac0f9945aee922', 'request_id': 'req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.914528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] The token cache is being invalidate because project 53c69ef6ef9440ddb1ac0f9945aee922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:11.915144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.916031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-716e7d31-e9b4-48b6-81d5-2bb38973b8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:11.917926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1038/2072] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:11 2021] DELETE /identity/v3/projects/53c69ef6ef9440ddb1ac0f9945aee922 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:11.927282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcaef4-8562-4334-9779-14536c2324dd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.927562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcaef4-8562-4334-9779-14536c2324dd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.927842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcaef4-8562-4334-9779-14536c2324dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.950183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-66bcaef4-8562-4334-9779-14536c2324dd None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:11.951807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-66bcaef4-8562-4334-9779-14536c2324dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.959284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1035/2073] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:11.962355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.962889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.963167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.973480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1039/2074] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:11.975490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:11.975884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:11.976364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:11.989137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:11.991628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:11.999984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:12.001964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.008489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1036/2075] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:12.008489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.019990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1040/2076] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:12.024330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.039479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae4dd-2936-4994-a6ee-cbc2e912e969 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.042001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db268a5-b873-43b7-8b0a-268f4c8e82c4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.046623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.047372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.047587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.047866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.048850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:12.049244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.050528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.050916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.051558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.051935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.052296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.053358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:12.054727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.057187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.064361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1041/2077] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:22:12.069198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.074854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1037/2078] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:12.076141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.078640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.082066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804544-f073-478f-ae6d-4e46c1eb56ee admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.087085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.088688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.089041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.089384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.090183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.092970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.094238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf5f92-67a0-4df2-87fe-bcda7a37347b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.099922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.100970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.101320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.101669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] PATH_INFO: `/v3/users/6d3164c0853e401880c32a50cdc8be53` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.106863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3164c0853e401880c32a50cdc8be53)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.110036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.137007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1042/2079] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:12.138074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.201067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3164c0853e401880c32a50cdc8be53'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.216194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3164c0853e401880c32a50cdc8be53'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.226232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3164c0853e401880c32a50cdc8be53'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.234010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3164c0853e401880c32a50cdc8be53'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.234202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc598-1ff6-46c6-bb64-06ad5a976a46 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.235035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3164c0853e401880c32a50cdc8be53'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.241825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1038/2080] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:12 2021] DELETE /identity/v3/users/6d3164c0853e401880c32a50cdc8be53 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:12.242381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.243724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.249121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.249821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.250103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.250376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.251100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.253556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e2f8-14c4-4885-86a6-83f27d52d675 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.292385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1043/2081] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:12.293867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.294152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.294427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.323670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:12.324940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.326043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d181b-f4de-49d3-9c7e-13d43caa396c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.398613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.399481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.399923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.400245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.401156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.401849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1044/2082] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:12.402541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.404137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.404489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.422929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1a13-ac3a-4902-81af-4324581e80a0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.427899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1039/2083] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:12.428838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.429567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.430462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.430890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.431056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.431349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.432372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.435283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.476189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1045/2084] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:12.476189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.489235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee64bb-bbbd-43b2-91d0-3095f2280d4e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.494242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.494966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.495254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.495519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.496275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.498086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.499827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f32e4-7bf3-44c9-9db0-72f9705ce350 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.503731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.504425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.504738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.505011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.514961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.516333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1046/2085] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:12.516612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.517378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.527472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1040/2086] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:12.528180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.535250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969ee8-58fb-4979-a094-b5cca6bf63aa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.538521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37e7c-7c6a-423c-af81-912a39c2a049 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.543615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.544869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.545073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.545073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.545073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.545653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.545860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.546237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.546834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.547275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.548463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.552093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.560666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1041/2087] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:12.565495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.582060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1047/2088] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:12.585036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2c4d-0f4f-42b2-b2b8-decc46c39203 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.586234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.588761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.588961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.589722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.590056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.590245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] PATH_INFO: `/v3/projects/5ba7a5834b1945d8a2f1d6f6e4460a38/users/9d2e78dcbf9b403a9c938977c229648a/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.603958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb5b9-77fd-422a-a969-83c6d20c9c0a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.616591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.617662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.617977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.618213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] PATH_INFO: `/v3/users/63ead3efa2ac43689d0b005a5bae8e79` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.619725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ead3efa2ac43689d0b005a5bae8e79)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.621898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.624767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba7a5834b1945d8a2f1d6f6e4460a38, user_id=9d2e78dcbf9b403a9c938977c229648a, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.630516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.654259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1042/2089] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:12 2021] PUT /identity/v3/projects/5ba7a5834b1945d8a2f1d6f6e4460a38/users/9d2e78dcbf9b403a9c938977c229648a/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:12.664966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.687798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ead3efa2ac43689d0b005a5bae8e79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.688534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ead3efa2ac43689d0b005a5bae8e79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.697097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ead3efa2ac43689d0b005a5bae8e79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.714900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ead3efa2ac43689d0b005a5bae8e79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.729231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fbddca60-e83d-4d9a-b585-9cbaa47c2578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ead3efa2ac43689d0b005a5bae8e79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:12.742107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1048/2090] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:12 2021] DELETE /identity/v3/users/63ead3efa2ac43689d0b005a5bae8e79 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:12.743838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87530f94-db8b-4444-a144-ca9efae66d53 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.744193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87530f94-db8b-4444-a144-ca9efae66d53 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.744737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87530f94-db8b-4444-a144-ca9efae66d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.780027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-87530f94-db8b-4444-a144-ca9efae66d53 None None] MFA Rules not processed for user `9d2e78dcbf9b403a9c938977c229648a`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:12.782321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-87530f94-db8b-4444-a144-ca9efae66d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.786232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643182b-1a3d-4c46-9962-d7bbe425c1f3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:12.883148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:12.883647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.883929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.888346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.888346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:12.890104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:12.891822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1049/2091] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:12.895208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:12.895624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:12.896051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:12.915477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1043/2092] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:12.915477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.917510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.939628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:12.941669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:12.960939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1050/2093] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:12.962895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:12.978868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.002560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadd314-86d7-4654-9342-715140b7e94d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.011457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.013137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.013632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.014139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] PATH_INFO: `/v3/projects/9264b7d2b1b4444f848035561e48c126/users/5686da93293e439eaf999b67fc154b14/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.024918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b522-ec53-4ea5-9dd1-bda39df15805 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.030455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.031599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.032100 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.032645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.034868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9264b7d2b1b4444f848035561e48c126, user_id=5686da93293e439eaf999b67fc154b14, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.037625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.044270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.046000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.056740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1044/2094] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:13.057431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1051/2095] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:12 2021] PUT /identity/v3/projects/9264b7d2b1b4444f848035561e48c126/users/5686da93293e439eaf999b67fc154b14/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:13.059253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.061399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.063754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.063917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.085165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a6f80-dcd7-41f7-a27b-f77e47d85def service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.146084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af7cb-4737-4d7e-bf83-bdb62e340f44 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.152423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.153389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.153681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.154188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.167618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.168625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.168962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.169300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] PATH_INFO: `/v3/projects/d57fbcb444734dd38b120c846774cff9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.170687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57fbcb444734dd38b120c846774cff9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.177696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.240492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57fbcb444734dd38b120c846774cff9', 'request_id': 'req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.247051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.248687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57fbcb444734dd38b120c846774cff9', 'request_id': 'req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.255922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031d69-f0fe-41ff-8a88-add39a237675 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.256308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57fbcb444734dd38b120c846774cff9', 'request_id': 'req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.280550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] The token cache is being invalidate because project d57fbcb444734dd38b120c846774cff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:13.280550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.280550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.280951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1052/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:13.281047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1045/2097] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:13 2021] DELETE /identity/v3/projects/d57fbcb444734dd38b120c846774cff9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:13.281047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.281269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.281908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.282431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.282547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.313996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:13.316039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.360397 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa1f05-e8a1-4f1f-87c5-51a8dc3a9df2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.366933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.368082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.368500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.368875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] PATH_INFO: `/v3/users/9d2e78dcbf9b403a9c938977c229648a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.371069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2e78dcbf9b403a9c938977c229648a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.373250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.453420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2e78dcbf9b403a9c938977c229648a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.464843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1053/2098] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:13.466348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.476847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2e78dcbf9b403a9c938977c229648a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.485088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.487987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2e78dcbf9b403a9c938977c229648a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.505576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2e78dcbf9b403a9c938977c229648a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.506019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c63481-c072-4271-8d2e-d6a44264936a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.506997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2e78dcbf9b403a9c938977c229648a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.512171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.513265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.513556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.513814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] PATH_INFO: `/v3/users/ad43d92ab74f4fe19b4175c0247a8148` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.515326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad43d92ab74f4fe19b4175c0247a8148)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.517494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1046/2099] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:13 2021] DELETE /identity/v3/users/9d2e78dcbf9b403a9c938977c229648a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:13.518758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.520599 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.524666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.591109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad43d92ab74f4fe19b4175c0247a8148'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.592775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad43d92ab74f4fe19b4175c0247a8148'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.604852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad43d92ab74f4fe19b4175c0247a8148'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.605700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413314a-e255-4615-ad9b-560720ce521f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.610889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.611797 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.612158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.612393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.614509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.622123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad43d92ab74f4fe19b4175c0247a8148'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.634932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2ece1b95-671d-40e9-ad2f-3a099f3e7277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad43d92ab74f4fe19b4175c0247a8148'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.646617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1054/2100] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:13 2021] DELETE /identity/v3/users/ad43d92ab74f4fe19b4175c0247a8148 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:13.649442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.649917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.650483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.685903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:13.688094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.710088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.712110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.724491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1047/2101] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:13.725696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.727247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.743681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bada968-9f16-45c7-af3b-19b257365696 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.815730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1055/2102] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:13.828093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.830837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.841931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.842894 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.843270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.843928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] PATH_INFO: `/v3/projects/7528a41cea5d44909a76c097fa79a775` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.845084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7528a41cea5d44909a76c097fa79a775)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.847540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.927072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7528a41cea5d44909a76c097fa79a775', 'request_id': 'req-e3729228-b221-4f9f-a661-f6519ff74619'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.937524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7646-d569-4fe8-a73f-ff97d6b8d1a8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.938779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7528a41cea5d44909a76c097fa79a775', 'request_id': 'req-e3729228-b221-4f9f-a661-f6519ff74619'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.951221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7528a41cea5d44909a76c097fa79a775', 'request_id': 'req-e3729228-b221-4f9f-a661-f6519ff74619'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.980818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] The token cache is being invalidate because project 7528a41cea5d44909a76c097fa79a775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:13.980818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.981555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:13.983398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1048/2103] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:13 2021] DELETE /identity/v3/projects/7528a41cea5d44909a76c097fa79a775 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:13.989630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.993931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.024468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.026349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.026663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.029541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.046875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.093621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729228-b221-4f9f-a661-f6519ff74619 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:14.098176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.099081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.099538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.099646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] PATH_INFO: `/v3/users/b6c2e539c9d34ed0ad34b426b3763640` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.100980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c2e539c9d34ed0ad34b426b3763640)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.102978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.140957 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.142881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.155892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1056/2104] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:14.156900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:14.158479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.185639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c2e539c9d34ed0ad34b426b3763640'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.187702 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960fd0-664d-4076-ba3c-f0eea313104a service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:14.194900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.196248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.196703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.200752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] PATH_INFO: `/v3/projects/e4617392279d4cfda771abf386dbede4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.202415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c2e539c9d34ed0ad34b426b3763640'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.202533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4617392279d4cfda771abf386dbede4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.204555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.215853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c2e539c9d34ed0ad34b426b3763640'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.227742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c2e539c9d34ed0ad34b426b3763640'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.229150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c2e539c9d34ed0ad34b426b3763640'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.239662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1049/2105] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:13 2021] DELETE /identity/v3/users/b6c2e539c9d34ed0ad34b426b3763640 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:14.293519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4617392279d4cfda771abf386dbede4', 'request_id': 'req-40c531f0-36d1-4132-8457-ce209d8b8dd6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.305916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4617392279d4cfda771abf386dbede4', 'request_id': 'req-40c531f0-36d1-4132-8457-ce209d8b8dd6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.316375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4617392279d4cfda771abf386dbede4', 'request_id': 'req-40c531f0-36d1-4132-8457-ce209d8b8dd6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.332959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] The token cache is being invalidate because project e4617392279d4cfda771abf386dbede4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:14.333342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.334265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.340735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1057/2106] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:14 2021] DELETE /identity/v3/projects/e4617392279d4cfda771abf386dbede4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:14.345232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:14.347538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.457445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b6f7-dca2-4b53-bef6-745024170218 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:14.540307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.542092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.542092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.542385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] PATH_INFO: `/v3/users/eeabbee407c446f19f47bbbbae6f1459` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.543359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeabbee407c446f19f47bbbbae6f1459)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.545481 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.612602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeabbee407c446f19f47bbbbae6f1459'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.627976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeabbee407c446f19f47bbbbae6f1459'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.637766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeabbee407c446f19f47bbbbae6f1459'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.648731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeabbee407c446f19f47bbbbae6f1459'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.649591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeabbee407c446f19f47bbbbae6f1459'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.657569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1050/2107] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:14 2021] DELETE /identity/v3/users/eeabbee407c446f19f47bbbbae6f1459 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:14.717458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:14.718951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.735685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c531f0-36d1-4132-8457-ce209d8b8dd6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:14.756878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:14.758838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:14.849333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.852302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.852628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.852960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] PATH_INFO: `/v3/projects/2d186d51bd724effb37ad01bb21f947a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.856842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d186d51bd724effb37ad01bb21f947a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.860109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.868953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274696c6-d292-44e7-b025-23474c62e2f5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:14.874259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:14.875278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:14.877320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:14.878087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] PATH_INFO: `/v3/projects/5ba7a5834b1945d8a2f1d6f6e4460a38` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:14.879934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba7a5834b1945d8a2f1d6f6e4460a38)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:14.884402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:14.946269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d186d51bd724effb37ad01bb21f947a', 'request_id': 'req-92153e67-2f42-43b1-95a3-accf435e3537'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.947999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba7a5834b1945d8a2f1d6f6e4460a38', 'request_id': 'req-af7b6a50-2a51-41e0-8fca-2528f125c3ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.955399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba7a5834b1945d8a2f1d6f6e4460a38', 'request_id': 'req-af7b6a50-2a51-41e0-8fca-2528f125c3ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.963890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba7a5834b1945d8a2f1d6f6e4460a38', 'request_id': 'req-af7b6a50-2a51-41e0-8fca-2528f125c3ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.967439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d186d51bd724effb37ad01bb21f947a', 'request_id': 'req-92153e67-2f42-43b1-95a3-accf435e3537'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.982836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d186d51bd724effb37ad01bb21f947a', 'request_id': 'req-92153e67-2f42-43b1-95a3-accf435e3537'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.991346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] The token cache is being invalidate because project 5ba7a5834b1945d8a2f1d6f6e4460a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:14.991636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.992354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-af7b6a50-2a51-41e0-8fca-2528f125c3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:14.994877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1051/2108] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:14 2021] DELETE /identity/v3/projects/5ba7a5834b1945d8a2f1d6f6e4460a38 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:15.003237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fae9c-9ab8-45e6-9dd3-bf94866e9027 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.003237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fae9c-9ab8-45e6-9dd3-bf94866e9027 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.003237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fae9c-9ab8-45e6-9dd3-bf94866e9027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.008250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] The token cache is being invalidate because project 2d186d51bd724effb37ad01bb21f947a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:15.009106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.014386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-92153e67-2f42-43b1-95a3-accf435e3537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.020998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1058/2109] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:14 2021] DELETE /identity/v3/projects/2d186d51bd724effb37ad01bb21f947a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:15.025292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ef05-bcdb-4b17-865e-eba715d381e4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.025808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ef05-bcdb-4b17-865e-eba715d381e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.026091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ef05-bcdb-4b17-865e-eba715d381e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.043991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a20fae9c-9ab8-45e6-9dd3-bf94866e9027 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.045818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a20fae9c-9ab8-45e6-9dd3-bf94866e9027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.074270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cd29ef05-bcdb-4b17-865e-eba715d381e4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.075617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cd29ef05-bcdb-4b17-865e-eba715d381e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.130275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1052/2110] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.131877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.132260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.132624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.154111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.155798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.165009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1053/2111] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.165857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1059/2112] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.169340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.177977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.178362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.178695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.194762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679613bf-4848-427d-868d-25dc2a6f9aa5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.200899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.201673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.202066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.202414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.203758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:15.203947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.207013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.208917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.210770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.223634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1054/2113] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:22:15.228052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.228619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1060/2114] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.229809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.242725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d909-4aa0-412d-9f3e-63e8536850f2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.245444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616aa7f-26d8-46d7-b53f-543a867f7989 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.249459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.250502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.251019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.251605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.252714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:15.253338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.254114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.255004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.255119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.255414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.255751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.257116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.260222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.276568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1055/2115] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:15.290810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.314641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1061/2116] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:15.315656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.318905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.323246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbefe-0ac9-41fb-9606-0575d3f4072e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.426472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.427169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.427446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.427720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.428488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.430505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.435091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83237275-6f17-4c9b-b198-281e41e49a8c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.442156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.443226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.443572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.443914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] PATH_INFO: `/v3/projects/f43619f1944b4611ae538a51789743d9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.445547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43619f1944b4611ae538a51789743d9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.448162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.468418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1056/2117] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:15.469586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.554640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43619f1944b4611ae538a51789743d9', 'request_id': 'req-7a95ae0c-b56a-4607-b1b4-38995a3368e3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.578186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43619f1944b4611ae538a51789743d9', 'request_id': 'req-7a95ae0c-b56a-4607-b1b4-38995a3368e3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.587026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa4399-dc9f-44c0-b819-03102a96cf1c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.592175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43619f1944b4611ae538a51789743d9', 'request_id': 'req-7a95ae0c-b56a-4607-b1b4-38995a3368e3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.619166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] The token cache is being invalidate because project f43619f1944b4611ae538a51789743d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:15.619796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.621079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:15.628561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1062/2118] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:15 2021] DELETE /identity/v3/projects/f43619f1944b4611ae538a51789743d9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:15.629649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.635082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.697624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.699217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.699805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.700391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.701770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.706137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3dadb-6553-4e6f-9fd2-8bf61c7ffa83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.744949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1057/2119] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:15.746995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.747392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.747760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.770080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.772017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.778318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ae0c-b56a-4607-b1b4-38995a3368e3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.783462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1058/2120] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.784543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.796913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.797827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.798158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.798608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.799573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.800492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.802868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630425-6b45-410f-a6cd-d1277b34d67d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.826048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588e34c-60e3-4347-81b9-ee7f5311d4f2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.847308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.849032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.849555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.850019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.851356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.855714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.870033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1063/2121] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:15.871163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1059/2122] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:15.872185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.872698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.873019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.873291 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.884491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6978-c4ee-4187-9b97-8c4ea41e1532 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.891208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.892089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.893595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.893595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.894723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.897193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.902115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:15.903384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:15.914292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1060/2123] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:15.915872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.918606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1064/2124] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:15.919584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.934549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139286f-28cb-4ce3-befa-c3614229f234 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.938568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97077-dacc-4f71-9876-7e2a7262c799 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:15.952863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.953604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.953892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.957772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.957772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.959502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.961962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:15.962950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:15.963238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:15.963509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:15.965366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:15.969403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:15.989031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1061/2125] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:15.989943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:15.999928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1065/2126] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:16.000983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.031513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab76ee1-f7cf-4758-93bd-1d8e2074733c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.038201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.039126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.039454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.039690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] PATH_INFO: `/v3/projects/5627192b47484fdeb41b3bf2cc2d713e/users/a41512b1b9cd40fb93287cbc9abbac2f/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.046964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215bf9-aa2d-45c9-bd3c-d79b977bdd23 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.069068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.071178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.077414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.077414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.077680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5627192b47484fdeb41b3bf2cc2d713e, user_id=a41512b1b9cd40fb93287cbc9abbac2f, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.077760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:16.077760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.077976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.080447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8601c-37d8-4685-aef6-a7ea7da3f4e1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.104068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1066/2127] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:15 2021] PUT /identity/v3/projects/5627192b47484fdeb41b3bf2cc2d713e/users/a41512b1b9cd40fb93287cbc9abbac2f/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:16.105437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.144783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1062/2128] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:16.154759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117bff4-096e-467a-ab4e-51a031a83b01 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.158470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117bff4-096e-467a-ab4e-51a031a83b01 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.159578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117bff4-096e-467a-ab4e-51a031a83b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.224156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5086-b949-4c26-af8e-74e521ac5237 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.233002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.234389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.238270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.239438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] PATH_INFO: `/v3/projects/c8df29a8f5c748978b9176b7bd8b52e5/users/09952080d1424dadb45e5fb31117ddf9/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.275593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8df29a8f5c748978b9176b7bd8b52e5, user_id=09952080d1424dadb45e5fb31117ddf9, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.278856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.311095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1067/2129] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:16 2021] PUT /identity/v3/projects/c8df29a8f5c748978b9176b7bd8b52e5/users/09952080d1424dadb45e5fb31117ddf9/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:16.311973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.324236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b117bff4-096e-467a-ab4e-51a031a83b01 None None] MFA Rules not processed for user `a41512b1b9cd40fb93287cbc9abbac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:16.329650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b117bff4-096e-467a-ab4e-51a031a83b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:16.442690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3b06-1e0e-43bc-b390-76d84478d8d9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.461038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.462693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.463339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.465481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.468344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.470365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.518619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1068/2130] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:16.519128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1063/2131] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:16.520583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.520871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.521202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.524237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.568234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] MFA Rules not processed for user `09952080d1424dadb45e5fb31117ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:16.569767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:16.634354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73db-2acf-422d-ba19-92a47d0419fd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.645287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.647135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.648313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.648313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.649902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.653675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.687070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1069/2132] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:16.690091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.690634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:16.709909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1064/2133] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:16.712167 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.732380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c4d2e-aa81-4a74-8e4a-8d26b2339875 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.740470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.742200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.743030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.743606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.746259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.748647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.769309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1065/2134] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:16.770960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.776306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec6e7f-76a5-401b-9f30-29d09686aacb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.786590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.787797 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.788289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.788645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.791847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139b1c-b532-49b5-beb8-a609be14bad0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:16.801172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:16.802571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:16.803663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:16.803663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:16.805254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.824961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.924187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:16.925572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:16.927833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1066/2135] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:16.931182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.949066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1070/2136] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:16 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:16.949600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:16.970268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f511-0cb9-4b9a-9d62-da436f50a3ed service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.039366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c9fc-897c-4e2d-bf63-abafa8e81a65 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.062372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.066264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.066582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.067720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.069309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.071224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.102862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1067/2137] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:17.112046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.114904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.115816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.116160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.124600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.124600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.124600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.148095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1071/2138] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:16 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:17.151988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.164984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e0d6d-cf14-41fe-8475-9588c8904416 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.168477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770351ed-58dc-4e19-885d-34430492d942 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.172369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.173461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.173904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.174277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.175220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.177252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.198624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.201742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.213331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.214190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] PATH_INFO: `/v3/projects/2f07cf73dc954eaf9e9ff47fdc55a019/users/c67f6f53734649728b70230d5ee6071f/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.215113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1072/2139] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:17.220836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.248608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910fe05-a1fa-4377-825f-44f5b7618e12 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.270034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.272561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.289928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.292753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] PATH_INFO: `/v3/projects/a325f8a85edf4139acf52a8ec71d2ead/users/e8253b52e456499da01f7c4b5ca0d0c5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.360198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f07cf73dc954eaf9e9ff47fdc55a019, user_id=c67f6f53734649728b70230d5ee6071f, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.361541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a325f8a85edf4139acf52a8ec71d2ead, user_id=e8253b52e456499da01f7c4b5ca0d0c5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.365435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.365913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d1a65-5aca-4f79-ac27-6f6049412422 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.397968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1073/2140] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:17 2021] PUT /identity/v3/projects/a325f8a85edf4139acf52a8ec71d2ead/users/e8253b52e456499da01f7c4b5ca0d0c5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:17.399386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.402715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1068/2141] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:17 2021] PUT /identity/v3/projects/2f07cf73dc954eaf9e9ff47fdc55a019/users/c67f6f53734649728b70230d5ee6071f/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:17.420303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.421158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.422149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.516632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] MFA Rules not processed for user `c67f6f53734649728b70230d5ee6071f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:17.523336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:17.602726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21976841-8312-400f-b470-4df74efeb9c4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.724542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1069/2142] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:17 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:17.770237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.772792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:17.806000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.807320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.807833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.808333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.827188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.832535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.844903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1074/2143] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:17.851468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:17.887669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83fd1-0a76-47f0-a29c-842acda1ebcc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:17.895125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:17.895808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.896094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.896370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] PATH_INFO: `/v3/projects/a325f8a85edf4139acf52a8ec71d2ead/users/e8253b52e456499da01f7c4b5ca0d0c5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.903024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a325f8a85edf4139acf52a8ec71d2ead, user_id=e8253b52e456499da01f7c4b5ca0d0c5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:17.906210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98784b-5285-4c05-9c37-7cb1c25d4190 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:17.938756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1075/2144] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:17 2021] PUT /identity/v3/projects/a325f8a85edf4139acf52a8ec71d2ead/users/e8253b52e456499da01f7c4b5ca0d0c5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:17.952746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:17.953221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:17.953665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:17.966911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb586b72-113d-4e58-b655-62e9f98d1a62 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:18.042375 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:18.043696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:18.045440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] MFA Rules not processed for user `e8253b52e456499da01f7c4b5ca0d0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:18.045947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:18.046284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:18.047372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:18.146004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:18.148279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:18.176859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1070/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:17 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:18.220834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1076/2146] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:17 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:18.283267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:18.296061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9ba5a-a0c4-4674-a4f0-145d0bebfe00 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:18.308514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:18.316790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:18.317483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:18.317791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:18.343560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:18.349839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c49db-3b6e-436a-b79d-00f426cda09e service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:18.402670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1071/2147] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:18 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:18.448487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:18.621026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c65c0-152e-43e8-aa1c-ed01f838c61b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:18.632004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:18.633700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:18.633982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:18.634258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] PATH_INFO: `/v3/users/09952080d1424dadb45e5fb31117ddf9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:18.637893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09952080d1424dadb45e5fb31117ddf9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:18.647461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:18.775718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09952080d1424dadb45e5fb31117ddf9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:18.777193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09952080d1424dadb45e5fb31117ddf9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:18.788420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09952080d1424dadb45e5fb31117ddf9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:18.817764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09952080d1424dadb45e5fb31117ddf9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:18.856040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09952080d1424dadb45e5fb31117ddf9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:18.871113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1077/2148] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:18 2021] DELETE /identity/v3/users/09952080d1424dadb45e5fb31117ddf9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:18.875969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:18.876657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:18.877317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:18.907137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:18.922485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:19.083053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1072/2149] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:19.091153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:19.093220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:19.228510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38782-ff93-4bbe-a74c-d37fb762e312 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:19.235077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:19.235974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:19.236869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:19.237363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:19.250350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:19.252765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:19.273486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1078/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:19.835972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:19.838203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:19.874543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2393-ed59-4189-8507-aabace543c55 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:19.891759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:19.891759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:19.891759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:19.891759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] PATH_INFO: `/v3/projects/c8df29a8f5c748978b9176b7bd8b52e5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:19.897522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8df29a8f5c748978b9176b7bd8b52e5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:19.899947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:20.066500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8df29a8f5c748978b9176b7bd8b52e5', 'request_id': 'req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.086293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8df29a8f5c748978b9176b7bd8b52e5', 'request_id': 'req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.105446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8df29a8f5c748978b9176b7bd8b52e5', 'request_id': 'req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.164765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] The token cache is being invalidate because project c8df29a8f5c748978b9176b7bd8b52e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:20.165338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.166456 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.169345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1073/2151] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:19 2021] DELETE /identity/v3/projects/c8df29a8f5c748978b9176b7bd8b52e5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:20.179173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:20.212140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1899c3-0c00-4aed-af23-ae1ea08fc6f4 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:20.414549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:20.415750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:20.416206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:20.416681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] PATH_INFO: `/v3/users/e8253b52e456499da01f7c4b5ca0d0c5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:20.418310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8253b52e456499da01f7c4b5ca0d0c5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:20.420891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:20.565194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:20.566728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:20.573243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8253b52e456499da01f7c4b5ca0d0c5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.575950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8253b52e456499da01f7c4b5ca0d0c5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.585627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9bb6-7d85-464f-9fec-8b02211d5a06 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:20.592515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8253b52e456499da01f7c4b5ca0d0c5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.593224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:20.594565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:20.595009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:20.595883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] PATH_INFO: `/v3/users/d973cd865b0c4783a8168ecfdf108917` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:20.598917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d973cd865b0c4783a8168ecfdf108917)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:20.601443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:20.650538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8253b52e456499da01f7c4b5ca0d0c5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.676663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c06d9536-f813-4bf2-84f1-c3e874599fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8253b52e456499da01f7c4b5ca0d0c5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.688477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd973cd865b0c4783a8168ecfdf108917'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.704104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1079/2152] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:20 2021] DELETE /identity/v3/users/e8253b52e456499da01f7c4b5ca0d0c5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:20.709547 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd973cd865b0c4783a8168ecfdf108917'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.722062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd973cd865b0c4783a8168ecfdf108917'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.735272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd973cd865b0c4783a8168ecfdf108917'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.736593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd973cd865b0c4783a8168ecfdf108917'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:20.750065 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1074/2153] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:20 2021] DELETE /identity/v3/users/d973cd865b0c4783a8168ecfdf108917 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:20.754715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:20.755171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:20.755703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:20.818456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:20.821395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.031867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1080/2154] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:21.108134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:21.110509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.276222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d08b8-7b55-4d3e-b78a-0e7509f0333d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:21.276222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edd975-3955-4271-a325-255b461266db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:21.276222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd975-3955-4271-a325-255b461266db service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:21.276222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd975-3955-4271-a325-255b461266db service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:21.283686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edd975-3955-4271-a325-255b461266db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:21.289428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edd975-3955-4271-a325-255b461266db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:21.293800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edd975-3955-4271-a325-255b461266db service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:21.330136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1075/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:21.498504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:21.502596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.519187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38c6a-9f96-4f86-b5b8-fb234c42c38e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:21.528089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:21.530230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:21.531567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:21.532081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] PATH_INFO: `/v3/projects/a325f8a85edf4139acf52a8ec71d2ead` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:21.534765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a325f8a85edf4139acf52a8ec71d2ead)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:21.538730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:21.674336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a325f8a85edf4139acf52a8ec71d2ead', 'request_id': 'req-5078d07a-8090-4e42-8079-b89e4832c23a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:21.690478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a325f8a85edf4139acf52a8ec71d2ead', 'request_id': 'req-5078d07a-8090-4e42-8079-b89e4832c23a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:21.701193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a325f8a85edf4139acf52a8ec71d2ead', 'request_id': 'req-5078d07a-8090-4e42-8079-b89e4832c23a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:21.739285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] The token cache is being invalidate because project a325f8a85edf4139acf52a8ec71d2ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:21.739730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:21.740913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5078d07a-8090-4e42-8079-b89e4832c23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:21.744316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1081/2156] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:21 2021] DELETE /identity/v3/projects/a325f8a85edf4139acf52a8ec71d2ead => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:21.759684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:21.760191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:21.760601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:21.818606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:21.819898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.984701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1076/2157] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:22.008933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.009220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.009502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.038872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:22.041673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.058874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1082/2158] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:22.068536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.092870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5ad5-1ff8-4b5b-b010-8ad2e93014e5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.101570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.102771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.103275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.103738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.105545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:22.106093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.109367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87363-9537-4a69-8e52-2ad3ed405a58 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.138478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1077/2159] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:22.141313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.170035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5b12-ff34-48c8-8948-4ecdbaf96d3f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.184490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.187704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.189257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.189257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.190725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.196557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.250723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.251063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.251355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.253477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1083/2160] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:22 2021] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:22.263259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.292275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] MFA Rules not processed for user `5686da93293e439eaf999b67fc154b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:22.293904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.372170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7a0cd-c33b-4864-b37a-7478e1b4a6c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.379741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.380561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.380755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.381030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.381754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.383750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.401192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1078/2161] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:22 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:22.402106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.403824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.414130 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1084/2162] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:22 2021] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:22.415659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.423929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb91e-f8bb-4876-808d-adf22efb3c49 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.433123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fca34-f61f-4224-aaea-699fd2679ee3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.436057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.438220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.438972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.439784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] PATH_INFO: `/v3/projects/a7500edb10a243139c0674f4f8686f48` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.439968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.441312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.441806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.442045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.442379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7500edb10a243139c0674f4f8686f48)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.443037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.444793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.446520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.458058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1085/2163] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:22.462615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.464655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.540120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7500edb10a243139c0674f4f8686f48', 'request_id': 'req-723404c1-8608-4c86-b206-d4e1d03846da'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.547337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7500edb10a243139c0674f4f8686f48', 'request_id': 'req-723404c1-8608-4c86-b206-d4e1d03846da'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.560332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7500edb10a243139c0674f4f8686f48', 'request_id': 'req-723404c1-8608-4c86-b206-d4e1d03846da'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.572991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed722c-b194-4851-a198-efb7297689ab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.578760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] The token cache is being invalidate because project a7500edb10a243139c0674f4f8686f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:22.579207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.580252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.583043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1079/2164] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:22 2021] DELETE /identity/v3/projects/a7500edb10a243139c0674f4f8686f48 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:22.584130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.586347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.677314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.678139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.678571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.679089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.681574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.682581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723404c1-8608-4c86-b206-d4e1d03846da admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.690837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.691959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.692395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.692873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.694213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.697568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.715235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1080/2165] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:22.716564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.718946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:22.741683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e40a0c-afe5-4b7c-a833-d49fdd597eac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.748129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.749832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.750157 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.750472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] PATH_INFO: `/v3/users/e2fbc0e47a984ab38c5ff1efd30e6b0f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.752287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fbc0e47a984ab38c5ff1efd30e6b0f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.756134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.782005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.783961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.796768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1086/2166] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:22.797739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:22.811038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77108d1-9f00-4d3c-a7ce-cf13bf4143bd service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:22.819256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:22.820371 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.820677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.820961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] PATH_INFO: `/v3/projects/a9ba77ded2aa4696a6fa637264fba4b6/users/0f26aea20f4140a1a2cf9d48025040bd/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.833340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fbc0e47a984ab38c5ff1efd30e6b0f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.841908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ba77ded2aa4696a6fa637264fba4b6, user_id=0f26aea20f4140a1a2cf9d48025040bd, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:22.844979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25bfa-bc07-44d0-abce-45f7713b7984 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:22.859951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fbc0e47a984ab38c5ff1efd30e6b0f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.888595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1087/2167] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:22 2021] PUT /identity/v3/projects/a9ba77ded2aa4696a6fa637264fba4b6/users/0f26aea20f4140a1a2cf9d48025040bd/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:22.888876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fbc0e47a984ab38c5ff1efd30e6b0f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.890343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fbc0e47a984ab38c5ff1efd30e6b0f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.891582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fbc0e47a984ab38c5ff1efd30e6b0f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:22.898997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:22.899450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:22.899928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:22.908566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1081/2168] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:22 2021] DELETE /identity/v3/users/e2fbc0e47a984ab38c5ff1efd30e6b0f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:22.972955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] MFA Rules not processed for user `0f26aea20f4140a1a2cf9d48025040bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:22.974663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:23.212165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1088/2169] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:22 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:23.221038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:23.223727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:23.414395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd185b5-3f58-45d1-be62-3958b85b2a9a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:23.428395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:23.431524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:23.431940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:23.432233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:23.433090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:23.442269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:23.502973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1082/2170] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:23 2021] POST /identity/v3/projects => generated 389 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:23.509167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:23.542194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea12e2-24c9-4795-94a3-28c32e9a9616 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:23.716602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:23.719793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:23.852259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:23.853377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:23.853844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:23.854332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:23.856010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:23.859834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:23.949320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1089/2171] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:23 2021] POST /identity/v3/users => generated 301 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:23.966219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.021123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44179-5aa0-48eb-bfda-2373092ed021 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.044088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.045285 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.045731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24989-89e4-4e5f-a8bb-e9d197d0d8a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.045847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.046230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.047642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.050853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.065032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.072772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.076482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.076482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] PATH_INFO: `/v3/projects/8c841cb35d19419daee0151012bbf57d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.081776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c841cb35d19419daee0151012bbf57d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.085302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.099961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1090/2172] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:23 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:24.101929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.135781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b8ae-f67b-4550-8e8e-d4f52e1472af admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.156055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.160147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.160684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.161203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] PATH_INFO: `/v3/projects/c099e26ff6094685aa0995240221c5c7/users/e83cf0996e9643eca771cfd99e164fac/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.219504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c841cb35d19419daee0151012bbf57d', 'request_id': 'req-89ee7fb4-0f57-4763-a350-c624bd935b12'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:24.227007 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c099e26ff6094685aa0995240221c5c7, user_id=e83cf0996e9643eca771cfd99e164fac, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.232828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.240977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c841cb35d19419daee0151012bbf57d', 'request_id': 'req-89ee7fb4-0f57-4763-a350-c624bd935b12'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:24.263451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c841cb35d19419daee0151012bbf57d', 'request_id': 'req-89ee7fb4-0f57-4763-a350-c624bd935b12'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:24.288725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1091/2173] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:24 2021] PUT /identity/v3/projects/c099e26ff6094685aa0995240221c5c7/users/e83cf0996e9643eca771cfd99e164fac/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:24.299142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.311936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] The token cache is being invalidate because project 8c841cb35d19419daee0151012bbf57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:24.314108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:24.316485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89ee7fb4-0f57-4763-a350-c624bd935b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:24.320016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1083/2174] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:23 2021] DELETE /identity/v3/projects/8c841cb35d19419daee0151012bbf57d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:24.329630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1ccd-27e3-4b1a-8155-a1d7dc230ea8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.330313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1ccd-27e3-4b1a-8155-a1d7dc230ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.332046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1ccd-27e3-4b1a-8155-a1d7dc230ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.389418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-361f1ccd-27e3-4b1a-8155-a1d7dc230ea8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:24.393821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-361f1ccd-27e3-4b1a-8155-a1d7dc230ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:24.453804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652de8-7873-42fb-ac3b-543297b3b097 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.460320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.461133 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.461420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.461692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.462449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.464119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.480089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1092/2175] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:24 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:24.486965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.489313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:24.523503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7861cb-618d-4ce0-a2ba-ee737abc1d4b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.530035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1084/2176] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:24.544322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.545287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.545898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.546337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.548656 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.549556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.550021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] PATH_INFO: `/v3/projects/c099e26ff6094685aa0995240221c5c7/users/e83cf0996e9643eca771cfd99e164fac/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.553224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c099e26ff6094685aa0995240221c5c7, user_id=e83cf0996e9643eca771cfd99e164fac, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.556153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48a23-359c-49fe-8a6f-2711a49bdb40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.570978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1093/2177] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:24 2021] PUT /identity/v3/projects/c099e26ff6094685aa0995240221c5c7/users/e83cf0996e9643eca771cfd99e164fac/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:24.591070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.591661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.591937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.616847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:24.618400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:24.656062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] MFA Rules not processed for user `e83cf0996e9643eca771cfd99e164fac`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:24.658830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:24.733502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1085/2178] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:24.741000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.764321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0084d-d799-48dd-9159-6be385a13d9c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.781033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.782079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.782570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.788715 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.789217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:24.789785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.794210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.818467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1094/2179] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:24 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:24.837493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.842828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:24.843974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1086/2180] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:24.849515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.872592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d173af-3538-40e0-9a25-7a5356751996 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:24.882339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:24.884087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:24.884087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:24.884785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:24.885871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:24.889645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:24.940494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1087/2181] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:24 2021] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:24.946812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:24.951467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75703f6-437b-49d0-94c7-54ffd3235c90 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.128212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.128212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.128832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.128832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.129099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad751f-1ce4-45a9-90a0-dd30f59f7faa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.145593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.147042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.148986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.149755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.152927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.158889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.218224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1088/2182] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:24 2021] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:25.223326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.245042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb37d1-de9a-4255-9cf8-74aa733a09c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.245042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.245042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.245833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.245833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.246195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.247997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.267408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1089/2183] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:25 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:25.269256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.284731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf277-66ac-4cb9-b2bf-988380c538c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.290458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.291515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.291997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.292330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.293151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.294960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.312007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1090/2184] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:25 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:25.313105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.315255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.320054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a1b9b-f356-44bb-a2e8-08367a5ac5f3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.325406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e008b-5630-423c-be6b-5ec425229a4f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.331734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.333243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.333540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.333820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] PATH_INFO: `/v3/projects/9582dd51af5d4212b9d25a286b681e4f/users/d9d36cd1c0c14a37b44e09f23b764b9c/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.355079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9582dd51af5d4212b9d25a286b681e4f, user_id=d9d36cd1c0c14a37b44e09f23b764b9c, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.359869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.361718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1095/2185] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:24 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:25.389914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1091/2186] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:25 2021] PUT /identity/v3/projects/9582dd51af5d4212b9d25a286b681e4f/users/d9d36cd1c0c14a37b44e09f23b764b9c/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:25.403191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.404394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.404854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.489301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] MFA Rules not processed for user `d9d36cd1c0c14a37b44e09f23b764b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:25.492153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:25.599539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.658631 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1096/2187] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:25.665450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.741143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbfd-f0e8-4852-bc39-e0678f410acf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.747702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.749584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.750139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.750615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] PATH_INFO: `/v3/users/0f26aea20f4140a1a2cf9d48025040bd` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.753007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f26aea20f4140a1a2cf9d48025040bd)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.755912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.853886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3a97-cd6e-4ea5-a07a-945e6f495937 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:25.861382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f26aea20f4140a1a2cf9d48025040bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:25.871537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:25.872967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.873397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.874042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.875160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:25.880540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:25.918285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f26aea20f4140a1a2cf9d48025040bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:25.934282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f26aea20f4140a1a2cf9d48025040bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:25.949786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f26aea20f4140a1a2cf9d48025040bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:25.950861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45473ef9-a6a3-429c-98fd-318581023630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f26aea20f4140a1a2cf9d48025040bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:25.952794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1097/2188] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:25 2021] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:25.956995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:25.961695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:25.970076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1092/2189] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:25 2021] DELETE /identity/v3/users/0f26aea20f4140a1a2cf9d48025040bd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:25.972667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:25.972995 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:25.973296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:25.997576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:25.998961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:26.157256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1093/2190] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:26.174028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:26.178702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:26.189658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf444e5-0b79-4d11-927c-0941e3af7dd8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:26.212323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:26.212323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.213646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.215188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.215188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:26.219136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:26.301827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1098/2191] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:25 2021] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:26.303942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:26.331785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62f50-ee9a-4171-a1ee-e3d824c4605a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:26.333888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7c0f2-701c-4762-83d0-86b73cb93a62 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:26.337426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:26.338343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.338689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.339077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.364771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:26.364771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c610a1d-b902-45ac-be5c-d957230a7bbe service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:26.366671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1094/2192] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:22:26.368081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715274-f151-4d00-8bd3-d76023d7463c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.368368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715274-f151-4d00-8bd3-d76023d7463c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.368685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715274-f151-4d00-8bd3-d76023d7463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.378447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:26.380270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.381664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.382755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.386470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:26.390225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:26.417539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1099/2193] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:26 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:26.422274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:26.425793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a8715274-f151-4d00-8bd3-d76023d7463c None None] MFA Rules not processed for user `5686da93293e439eaf999b67fc154b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:26.427074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8715274-f151-4d00-8bd3-d76023d7463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:26.444974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1576-a49a-4bbf-bca1-68cc4cd85b92 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:26.461984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:26.463165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.466811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.469349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.470998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:26.483512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:26.536678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1100/2194] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:26 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:26.541651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:26.560166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63005-5854-4ff3-83f3-8a4382a8dea2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:26.576088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1095/2195] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:26.582509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:26.584974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.585907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.586798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] PATH_INFO: `/v3/projects/8fe6be8e8276477f9c1baf9bce568a74/users/0bc79ba25a264d5591bc6753f7abe2ce/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.612373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe6be8e8276477f9c1baf9bce568a74, user_id=0bc79ba25a264d5591bc6753f7abe2ce, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:26.618846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:26.635407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1101/2196] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:26 2021] PUT /identity/v3/projects/8fe6be8e8276477f9c1baf9bce568a74/users/0bc79ba25a264d5591bc6753f7abe2ce/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:26.646423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:26.646926 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:26.647746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:26.688045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] MFA Rules not processed for user `0bc79ba25a264d5591bc6753f7abe2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:26.697061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:26.813673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1096/2197] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:26 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:26.815700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:26.991107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3985c-3993-406e-8dc5-1357a323785b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.019733 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.020492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.020786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.021712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.023439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.025528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.068495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1102/2198] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:26 2021] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:27.070674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.094383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf60d-727a-48fe-9050-11a53d91866c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.175712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.179354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:27.272947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.274458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.275211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.277097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.278559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.282561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.330771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1097/2199] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:27 2021] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:27.335742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.362634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042eec5-4d0e-4aba-9cce-51a316022ffe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.366856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d3c68-c65b-4af9-bbc4-bf4c788d269c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.371604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.372548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.372830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.373104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] PATH_INFO: `/v3/projects/a9ba77ded2aa4696a6fa637264fba4b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.375211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ba77ded2aa4696a6fa637264fba4b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.376101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.377695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.377872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.379390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.384625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.396947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.403769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.453326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ba77ded2aa4696a6fa637264fba4b6', 'request_id': 'req-121a74e8-ccaf-4d11-b537-a9c7338584a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:27.471108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ba77ded2aa4696a6fa637264fba4b6', 'request_id': 'req-121a74e8-ccaf-4d11-b537-a9c7338584a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:27.481215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ba77ded2aa4696a6fa637264fba4b6', 'request_id': 'req-121a74e8-ccaf-4d11-b537-a9c7338584a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:27.485371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1098/2200] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:27.489545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.509270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] The token cache is being invalidate because project a9ba77ded2aa4696a6fa637264fba4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:27.510836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:27.512780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:27.515556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1103/2201] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:27 2021] DELETE /identity/v3/projects/a9ba77ded2aa4696a6fa637264fba4b6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:27.530280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74674e7a-9a38-4ca4-9d3c-906b1247b4e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.541521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.553294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:27.699746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.700035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.700295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.700489 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] PATH_INFO: `/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0/users/a86eda03aa5a4ed1b51ecfbb97f12db2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.725822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13c14df5cf84a39aded0a35ce1cb4e0, user_id=a86eda03aa5a4ed1b51ecfbb97f12db2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.728996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.751420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1099/2202] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:27 2021] PUT /identity/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0/users/a86eda03aa5a4ed1b51ecfbb97f12db2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:27.755982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a74e8-ccaf-4d11-b537-a9c7338584a3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.756701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:27.760601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:27.930833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.932005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.932627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.933150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] PATH_INFO: `/v3/users/e83cf0996e9643eca771cfd99e164fac` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.951405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83cf0996e9643eca771cfd99e164fac)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.951980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44656a5d-b1f8-4b3a-a177-eed6f5b12b7d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:27.957876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:27.958602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:27.958901 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:27.959194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:27.959973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:27.961750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:27.965760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:28.002355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1100/2203] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:28.008038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:28.048087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9dc21-611b-48e3-bc39-b39a9f5a6328 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:28.061043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:28.066820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:28.068373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:28.069372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] PATH_INFO: `/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0/users/a86eda03aa5a4ed1b51ecfbb97f12db2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:28.076608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13c14df5cf84a39aded0a35ce1cb4e0, user_id=a86eda03aa5a4ed1b51ecfbb97f12db2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:28.083876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01f3c-5a3d-48a6-a1c2-3a50ec5a3e8d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:28.093998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83cf0996e9643eca771cfd99e164fac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:28.095527 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83cf0996e9643eca771cfd99e164fac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:28.111696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83cf0996e9643eca771cfd99e164fac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:28.120479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1101/2204] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:28 2021] PUT /identity/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0/users/a86eda03aa5a4ed1b51ecfbb97f12db2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:28.132652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:28.133903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:28.133903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:28.142044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83cf0996e9643eca771cfd99e164fac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:28.155997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83cf0996e9643eca771cfd99e164fac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:28.172330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1104/2205] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:27 2021] DELETE /identity/v3/users/e83cf0996e9643eca771cfd99e164fac => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:28.203178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] MFA Rules not processed for user `a86eda03aa5a4ed1b51ecfbb97f12db2`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:28.205514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:28.408028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1102/2206] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:28 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:28.419641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:28.422325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:28.587063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c5a24-f0e0-4d70-9a04-0c34de95920f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:28.595949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:28.601405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:28.602068 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:28.602677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:28.626301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:28.628153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:28.659399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1105/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:28 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:28.763155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:28.767953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:28.795441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:28.797275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:28.814336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f547c-91cf-48a4-96ba-120eb77b4074 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:28.837541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:28.838721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:28.839197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:28.839670 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:28.842993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:29.013986 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2672f-11de-42f7-8a69-51921c084d5d service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.020454 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.021442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.021882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.022327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] PATH_INFO: `/v3/projects/c099e26ff6094685aa0995240221c5c7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.025208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c099e26ff6094685aa0995240221c5c7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.027286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.055935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.059875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcf404-3f90-4cf4-b93e-c5667f1f815e service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.095448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1103/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:28 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:29.118107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c099e26ff6094685aa0995240221c5c7', 'request_id': 'req-3e627a7a-311c-43cb-b14c-515e0bacf329'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:29.135380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c099e26ff6094685aa0995240221c5c7', 'request_id': 'req-3e627a7a-311c-43cb-b14c-515e0bacf329'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:29.149227 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c099e26ff6094685aa0995240221c5c7', 'request_id': 'req-3e627a7a-311c-43cb-b14c-515e0bacf329'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:29.181196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] The token cache is being invalidate because project c099e26ff6094685aa0995240221c5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:29.182347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:29.184696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3e627a7a-311c-43cb-b14c-515e0bacf329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:29.190629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1106/2209] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:28 2021] DELETE /identity/v3/projects/c099e26ff6094685aa0995240221c5c7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:29.198041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.198929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.199444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.267404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:29.270207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:29.415504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1104/2210] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:29.426280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf318d-a26d-462f-a100-708870108044 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.427180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf318d-a26d-462f-a100-708870108044 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.427967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf318d-a26d-462f-a100-708870108044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.467659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-53bf318d-a26d-462f-a100-708870108044 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:29.470201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-53bf318d-a26d-462f-a100-708870108044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:29.508634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1107/2211] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:29.514423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.536873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca5e43-1ca7-4ef8-a2da-499926211df1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.542689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.544694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.545431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.546331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.548767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:29.554275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.561769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.616650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1105/2212] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:29.620118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf318d-a26d-462f-a100-708870108044 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.643983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf318d-a26d-462f-a100-708870108044 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.665051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.666273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.666744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.667235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.668344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.672123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.709529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1108/2213] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:29 2021] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:29.717178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.733414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37bee-403a-4f46-b46e-48c3265eb0c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.806334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.807565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.807970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.808357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.809256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.811539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.832760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1106/2214] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:29 2021] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:29.838750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.850031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c45791-acb1-47bb-8683-80d2dcb33857 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.855456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.856129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.856403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.856699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.857449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.859234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.871103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1109/2215] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:29.875323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.886644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1953-b752-41a9-bd42-6f9179822e39 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.893454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.894418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.894838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.895460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.896603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.899521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eea7f-cd31-48e0-9855-64c10e1f17d2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.918896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1107/2216] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:29 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:29.923469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:29.934370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87cbad-8674-42d0-bac2-5fec4dbe5ddc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:29.940516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:29.941689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:29.942107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:29.942630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] PATH_INFO: `/v3/projects/7be3060402d04be3b1b6c9f29c4d7869/users/8c0f178d8d9f421da853f04df841e2ff/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:29.960277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be3060402d04be3b1b6c9f29c4d7869, user_id=8c0f178d8d9f421da853f04df841e2ff, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:29.963021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:29.985338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1110/2217] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:29 2021] PUT /identity/v3/projects/7be3060402d04be3b1b6c9f29c4d7869/users/8c0f178d8d9f421da853f04df841e2ff/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:30.005648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.005648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.005648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.053346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] MFA Rules not processed for user `8c0f178d8d9f421da853f04df841e2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:30.055445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:30.139563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1108/2218] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:30.145920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.235518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbfdd-6999-42d4-9f99-4a6b19b06022 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.244322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.245445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.245931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.246380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.247624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.251069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.304421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1111/2219] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:30 2021] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:30.306973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.320681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d79d4-6e29-46af-9cf6-e988f60e76d2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.392262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.393148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.394098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.394510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.395472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.397803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.420327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1109/2220] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:30 2021] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:30.425302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.437037 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb0a6-a056-491e-be9e-a87b7600174d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.442684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.443378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.443668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.443919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.444700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.446316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.461092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1112/2221] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:30.465832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.482470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489ade5-120e-4f77-9412-e977bdac4473 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.490136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.491631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.492089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.492582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] PATH_INFO: `/v3/projects/3385eb5de1604d8587bb009ce1c265f6/users/10b401b377e7446eaed3600396b3afa2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.517323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3385eb5de1604d8587bb009ce1c265f6, user_id=10b401b377e7446eaed3600396b3afa2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.522319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.541217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1110/2222] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:30 2021] PUT /identity/v3/projects/3385eb5de1604d8587bb009ce1c265f6/users/10b401b377e7446eaed3600396b3afa2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:30.545512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.557225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd101906-7be2-4b1b-a9b6-500e215f8401 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.666089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.667283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.667725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.668150 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.668967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.670991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f9a9a-85bd-4f33-8194-8300a97a9b92 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.686771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1113/2223] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:30 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:30.692504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.703399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae01ce-5ed1-40de-8153-78419223eab0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.709337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.710216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.710496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.710767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] PATH_INFO: `/v3/projects/3385eb5de1604d8587bb009ce1c265f6/users/10b401b377e7446eaed3600396b3afa2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.713064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3385eb5de1604d8587bb009ce1c265f6, user_id=10b401b377e7446eaed3600396b3afa2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:30.716785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:30.732578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1111/2224] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:30 2021] PUT /identity/v3/projects/3385eb5de1604d8587bb009ce1c265f6/users/10b401b377e7446eaed3600396b3afa2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:30.744145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.744689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.744985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:30.775776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] MFA Rules not processed for user `10b401b377e7446eaed3600396b3afa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:30.777094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:30.871520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1114/2225] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:30 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:30.882189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:30.884188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:30.958999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde979e-1dbf-44d1-9c71-8b2ce1aa121f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:30.963821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:30.964950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:30.964950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:30.965164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:31.027642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:31.029162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f5ed2-400a-4084-ab97-722b6f02e1bc service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:31.039459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1112/2226] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:30 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:34.824374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:34.826154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:34.914118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83b1a-58b7-49b2-bca6-9050889b7a22 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:34.919821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:34.920849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:34.921510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:34.922070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] PATH_INFO: `/v3/users/2148d1cf990047d8b7963cd7c33a6a24` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:34.923735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2148d1cf990047d8b7963cd7c33a6a24)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:34.926563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:35.002289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2148d1cf990047d8b7963cd7c33a6a24'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:35.011792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2148d1cf990047d8b7963cd7c33a6a24'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:35.025627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2148d1cf990047d8b7963cd7c33a6a24'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:35.040168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2148d1cf990047d8b7963cd7c33a6a24'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:35.049912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2148d1cf990047d8b7963cd7c33a6a24'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:35.057235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1115/2227] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:34 2021] DELETE /identity/v3/users/2148d1cf990047d8b7963cd7c33a6a24 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:35.062104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:35.062743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:35.062743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:35.081511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:35.082741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:35.181176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1113/2228] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:35.192699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:35.194642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:35.307512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fce15-0af0-4a71-bc56-2330635e5244 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:35.316116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:35.316874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:35.317142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:35.317542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:35.338848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:35.340993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:35.357070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1116/2229] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:35.816315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:35.818709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:35.907906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8ce7-6877-4d75-83b9-9e3ccfe111d2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:35.952598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:35.955521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:35.958514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:35.961493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] PATH_INFO: `/v3/projects/ac9d5f3f67a44b73acf33063403c2c88` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:35.967308 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9d5f3f67a44b73acf33063403c2c88)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:35.972535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.101749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.103439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.112505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9d5f3f67a44b73acf33063403c2c88', 'request_id': 'req-d6300967-ceec-49cc-b5dd-8cf972de9698'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.129557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9d5f3f67a44b73acf33063403c2c88', 'request_id': 'req-d6300967-ceec-49cc-b5dd-8cf972de9698'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.141616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d972f-3390-483c-b676-acd5042a327d service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.161135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9d5f3f67a44b73acf33063403c2c88', 'request_id': 'req-d6300967-ceec-49cc-b5dd-8cf972de9698'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.188050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] The token cache is being invalidate because project ac9d5f3f67a44b73acf33063403c2c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:36.188906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.191263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d6300967-ceec-49cc-b5dd-8cf972de9698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.194460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1114/2230] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:35 2021] DELETE /identity/v3/projects/ac9d5f3f67a44b73acf33063403c2c88 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:36.203701 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98086-7beb-42a9-929e-007c3a41e8ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.204146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98086-7beb-42a9-929e-007c3a41e8ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.204592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98086-7beb-42a9-929e-007c3a41e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.236159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-60a98086-7beb-42a9-929e-007c3a41e8ea None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:36.237993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-60a98086-7beb-42a9-929e-007c3a41e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.241842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.243087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.243490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.243877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] PATH_INFO: `/v3/users/d9d36cd1c0c14a37b44e09f23b764b9c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.245586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d36cd1c0c14a37b44e09f23b764b9c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.248825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.250740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1115/2231] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:36.268860 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.269277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.271230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.299058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:36.309315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.320956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1116/2232] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:36.328019 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d36cd1c0c14a37b44e09f23b764b9c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.328750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d36cd1c0c14a37b44e09f23b764b9c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.341603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.347439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d36cd1c0c14a37b44e09f23b764b9c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.358703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9dd9-dfe7-4c3e-bbb5-fd7123456cd0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.365968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.367311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.367863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.368853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.369878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:36.370558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.373657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.374564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d36cd1c0c14a37b44e09f23b764b9c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.388850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7223989a-e8f3-49c5-a23c-38e9d7da504e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d36cd1c0c14a37b44e09f23b764b9c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:36.392000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1117/2233] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:36.398478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.400579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.405833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1117/2234] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:36 2021] DELETE /identity/v3/users/d9d36cd1c0c14a37b44e09f23b764b9c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:36.415047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.415910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.416498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.428634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce109f-64a8-4965-a1a9-e05ecac41fe0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.453514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:36.455190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.532056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.533647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.534466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1118/2235] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:36.534772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.535268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.536594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.540488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.545322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.547185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.578634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1118/2236] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/projects => generated 359 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:36.584168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.681379 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8c3d5-57e4-445a-9db9-e9db2bfd10e4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.691980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8369d5-8376-4d3e-883c-a2e92e1541bf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.697888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.698617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.698897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.699389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.700145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.702682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.731853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1119/2237] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/users => generated 280 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:36.741615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.757909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f113-bab2-4907-8bbc-0d9c964bc697 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.763377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.764231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.764775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.765235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.766216 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.768117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.772564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.773686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.774182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.774659 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.781700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1120/2238] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:36 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:36.785817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.792572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.795484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.796058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cda812-5b8c-4a13-bb0c-d1046621f3e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.801535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.802391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.802688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.802968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.803749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.805440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.814523 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1119/2239] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:36.817684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1121/2240] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:36.825089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.843459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfccd9-3e94-4b9a-8acd-64501456e250 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.852012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:36.853608 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.854100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.854571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] PATH_INFO: `/v3/projects/3a3885b06f434c1e94afe88b35782146/users/2d94f72d45e040c68b1b902da6c7a6f4/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:36.889009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3885b06f434c1e94afe88b35782146, user_id=2d94f72d45e040c68b1b902da6c7a6f4, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:36.895247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe79c74-1174-4ffd-88db-e41ed8ee326f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:36.909282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:36.912284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:36.929579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12cf4-c96f-40c1-8d90-8e2b47fabfaf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:36.944200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1120/2241] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:36 2021] PUT /identity/v3/projects/3a3885b06f434c1e94afe88b35782146/users/2d94f72d45e040c68b1b902da6c7a6f4/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:36.949447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:36.949922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:36.950518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.007438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] MFA Rules not processed for user `2d94f72d45e040c68b1b902da6c7a6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:37.012295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.017514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:37.018769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:37.019304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:37.019654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] PATH_INFO: `/v3/users/c67f6f53734649728b70230d5ee6071f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.021604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67f6f53734649728b70230d5ee6071f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:37.024072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:37.105448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1121/2242] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:36 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:37.138966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67f6f53734649728b70230d5ee6071f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.163295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:37.165825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.181341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67f6f53734649728b70230d5ee6071f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.202121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67f6f53734649728b70230d5ee6071f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.226907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67f6f53734649728b70230d5ee6071f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.228383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abe3e824-664c-468a-aa31-bebcc7a0a688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67f6f53734649728b70230d5ee6071f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.247808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1122/2243] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:36 2021] DELETE /identity/v3/users/c67f6f53734649728b70230d5ee6071f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:37.258431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:37.259141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:37.259766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.261883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce331-a2e1-4ae5-8109-139385a81dcc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:37.314763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:37.318467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.385894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:37.386582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:37.387042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:37.387464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.394088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.482668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1123/2244] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:37.484059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:37.486830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.516099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc745b27-ccd5-44ae-aa33-5eaa8665bd7c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:37.523047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:37.524398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:37.525039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:37.525845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.529992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.541120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:37.543496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:37.580191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1122/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:37 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:22:37.581839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:37.587718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.620824 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ef8e1-31e8-4a31-862d-373a35e202a1 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:37.630978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:37.633846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:37.633846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:37.633846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] PATH_INFO: `/v3/projects/9582dd51af5d4212b9d25a286b681e4f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:37.634934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9582dd51af5d4212b9d25a286b681e4f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:37.637488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:37.668409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:37.671340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:37.703620 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1124/2246] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:37 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:37.710387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:37.715355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.764964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9582dd51af5d4212b9d25a286b681e4f', 'request_id': 'req-e6aad55e-068f-4919-a8c7-dd19f99e3888'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.792000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9582dd51af5d4212b9d25a286b681e4f', 'request_id': 'req-e6aad55e-068f-4919-a8c7-dd19f99e3888'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.828487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9582dd51af5d4212b9d25a286b681e4f', 'request_id': 'req-e6aad55e-068f-4919-a8c7-dd19f99e3888'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.874593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] The token cache is being invalidate because project 9582dd51af5d4212b9d25a286b681e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:37.875365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.883772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:37.887034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1123/2247] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:37 2021] DELETE /identity/v3/projects/9582dd51af5d4212b9d25a286b681e4f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:37.888581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:37.890995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:37.940902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970f08-6378-498d-9263-ffa023f42f16 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.078881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.081665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.082231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.083350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.088575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.135566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad55e-068f-4919-a8c7-dd19f99e3888 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.143443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.145036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.145684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.146132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] PATH_INFO: `/v3/users/2d94f72d45e040c68b1b902da6c7a6f4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.148457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d94f72d45e040c68b1b902da6c7a6f4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.151959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:38.219064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.222378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:38.238339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1125/2248] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:38.239432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:38.241589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.243953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d94f72d45e040c68b1b902da6c7a6f4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.245045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d94f72d45e040c68b1b902da6c7a6f4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.261368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d94f72d45e040c68b1b902da6c7a6f4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.266426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc17ec-019a-4ad1-9c85-641abe31766b service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.276849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.277764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.278043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.278313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] PATH_INFO: `/v3/users/0bc79ba25a264d5591bc6753f7abe2ce` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.280776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc79ba25a264d5591bc6753f7abe2ce)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.284241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:38.287737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d94f72d45e040c68b1b902da6c7a6f4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.302625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0dccc7bc-a215-4dec-9985-0eb435ac8088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d94f72d45e040c68b1b902da6c7a6f4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.319143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1124/2249] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:37 2021] DELETE /identity/v3/users/2d94f72d45e040c68b1b902da6c7a6f4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:38.333077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.334144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.335206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.373091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:38.375546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.380973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc79ba25a264d5591bc6753f7abe2ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.413592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc79ba25a264d5591bc6753f7abe2ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.430376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc79ba25a264d5591bc6753f7abe2ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.450991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc79ba25a264d5591bc6753f7abe2ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.451783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc79ba25a264d5591bc6753f7abe2ce'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:38.463992 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1126/2250] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:38 2021] DELETE /identity/v3/users/0bc79ba25a264d5591bc6753f7abe2ce => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:38.537497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1125/2251] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:38.551193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:38.552838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.626173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ba15-1d95-42c0-813c-282b85c9a942 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.630428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.631137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.631565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.631763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.724348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.727270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:38.746638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1127/2252] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:38.865244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:38.867248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.889023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7df753-2c1e-4f8a-a44d-fd172ec1951d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.898988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.900407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.900906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.901375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] PATH_INFO: `/v3/users/a41512b1b9cd40fb93287cbc9abbac2f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.903854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41512b1b9cd40fb93287cbc9abbac2f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.907632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:38.941829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:38.949320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:38.968639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0a4a-301d-4abe-8397-7936792930dc service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:38.992079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:38.993269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:38.993555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:38.993829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] PATH_INFO: `/v3/projects/2f07cf73dc954eaf9e9ff47fdc55a019` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:38.995241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f07cf73dc954eaf9e9ff47fdc55a019)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:38.998289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:39.053400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41512b1b9cd40fb93287cbc9abbac2f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.055003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41512b1b9cd40fb93287cbc9abbac2f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.073468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41512b1b9cd40fb93287cbc9abbac2f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.099532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41512b1b9cd40fb93287cbc9abbac2f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.120513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f07cf73dc954eaf9e9ff47fdc55a019', 'request_id': 'req-bc8709da-d165-4b73-ac92-e5bd45275537'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.120737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-722cc7ca-beb7-4cab-aa70-b19e5c4fc3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41512b1b9cd40fb93287cbc9abbac2f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.129827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f07cf73dc954eaf9e9ff47fdc55a019', 'request_id': 'req-bc8709da-d165-4b73-ac92-e5bd45275537'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.140490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1126/2253] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:38 2021] DELETE /identity/v3/users/a41512b1b9cd40fb93287cbc9abbac2f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:39.146801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:39.147843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:39.148649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:39.159668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f07cf73dc954eaf9e9ff47fdc55a019', 'request_id': 'req-bc8709da-d165-4b73-ac92-e5bd45275537'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.190319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:39.192691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:39.210884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] The token cache is being invalidate because project 2f07cf73dc954eaf9e9ff47fdc55a019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:39.211561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.213540 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.235459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1128/2254] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:38 2021] DELETE /identity/v3/projects/2f07cf73dc954eaf9e9ff47fdc55a019 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:39.371101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:39.373516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:39.468493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1127/2255] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:39.477983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:39.481079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:39.515716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02b623-74d0-4038-8042-df0bf5750b65 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:39.539506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:39.540160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:39.540723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:39.541529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] PATH_INFO: `/v3/projects/3a3885b06f434c1e94afe88b35782146` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:39.545498 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3885b06f434c1e94afe88b35782146)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:39.548803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:39.585437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8709da-d165-4b73-ac92-e5bd45275537 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:39.592498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:39.593887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:39.594862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:39.596244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] PATH_INFO: `/v3/projects/8fe6be8e8276477f9c1baf9bce568a74` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:39.598451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe6be8e8276477f9c1baf9bce568a74)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:39.601057 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:39.667750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3885b06f434c1e94afe88b35782146', 'request_id': 'req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.689709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3885b06f434c1e94afe88b35782146', 'request_id': 'req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.700269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe6be8e8276477f9c1baf9bce568a74', 'request_id': 'req-3c457421-ba3f-4c21-8ea8-54c000d15f8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.701796 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3885b06f434c1e94afe88b35782146', 'request_id': 'req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.709777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe6be8e8276477f9c1baf9bce568a74', 'request_id': 'req-3c457421-ba3f-4c21-8ea8-54c000d15f8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.718859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe6be8e8276477f9c1baf9bce568a74', 'request_id': 'req-3c457421-ba3f-4c21-8ea8-54c000d15f8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.736124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] The token cache is being invalidate because project 3a3885b06f434c1e94afe88b35782146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:39.737316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.740167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.752373 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1128/2256] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:39 2021] DELETE /identity/v3/projects/3a3885b06f434c1e94afe88b35782146 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:39.754532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:39.757322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:39.765309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] The token cache is being invalidate because project 8fe6be8e8276477f9c1baf9bce568a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:39.765789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.766850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c457421-ba3f-4c21-8ea8-54c000d15f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:39.770727 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1129/2257] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:39 2021] DELETE /identity/v3/projects/8fe6be8e8276477f9c1baf9bce568a74 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:39.773760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:39.774215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:39.774662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:39.810609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:39.813603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:39.923408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46ec11-38dd-4d72-a5d3-b8d0f82c812b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.057149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1130/2258] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:40.058811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.060983 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.079416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1329a-7105-49ed-9312-44db6c6039e5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.081195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.082372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.083157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.083568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.086795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.088628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.090460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.091087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.091690 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] PATH_INFO: `/v3/users/a86eda03aa5a4ed1b51ecfbb97f12db2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.095600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86eda03aa5a4ed1b51ecfbb97f12db2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.100111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.105667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.107321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe02e64-b837-4952-9c64-464176a22b51 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.127363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1129/2259] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:40.130288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.130822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.131375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.160342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:40.161755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.173261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1130/2260] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:40.178403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.192679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a83c6-1237-471e-9fa7-7b8f765746ef None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.199131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.200082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.200367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.200964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.201968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:40.202184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.204197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.222748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86eda03aa5a4ed1b51ecfbb97f12db2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.225922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1131/2261] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:40.226938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.242815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee795-8512-4e71-a9aa-4ae50309f37e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.244562 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86eda03aa5a4ed1b51ecfbb97f12db2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.254519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.255691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.256356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.256859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.257627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86eda03aa5a4ed1b51ecfbb97f12db2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.258190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.264030 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.273132 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86eda03aa5a4ed1b51ecfbb97f12db2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.274253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86eda03aa5a4ed1b51ecfbb97f12db2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.282803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1131/2262] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:40 2021] DELETE /identity/v3/users/a86eda03aa5a4ed1b51ecfbb97f12db2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:40.332241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1132/2263] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:40 2021] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:40.335169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.338282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.459372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da87f8-3af2-4035-8f68-419023c7287d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.531386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.531968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.532255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.533261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.533462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.535424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.559035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1132/2264] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:40 2021] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:40.563894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.576397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998dda-cca6-4c48-990d-6e688b75a772 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.584331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.586261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.586261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.586261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.587551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.589947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.609751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1133/2265] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:40 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:40.611747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.631159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4d8-2399-4cb3-a506-879e0680e241 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.645671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.647893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.648464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.648932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.651084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.654159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.682517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1133/2266] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:40 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:40.684746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.708730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b868c-b127-4d3e-b249-090a6c17fc07 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.719462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.722918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.726502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.726502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] PATH_INFO: `/v3/projects/6f1dffc761a64825a00bef3099b17c89/users/d38e42db19b34675a217555e0982b9aa/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.764063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.767222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.793636 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1dffc761a64825a00bef3099b17c89, user_id=d38e42db19b34675a217555e0982b9aa, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.799352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd9ca5-6429-4d24-a83c-45fb386d3844 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.814235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923da52-26e5-4205-b0e7-d85509525f3c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:40.829999 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:40.832127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.832812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1134/2267] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:40 2021] PUT /identity/v3/projects/6f1dffc761a64825a00bef3099b17c89/users/d38e42db19b34675a217555e0982b9aa/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:40.833091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.833550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] PATH_INFO: `/v3/projects/5627192b47484fdeb41b3bf2cc2d713e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.835439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5627192b47484fdeb41b3bf2cc2d713e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:40.837639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:40.852408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f254b-49c9-4ac0-b710-4002ccf88b42 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:40.852926 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f254b-49c9-4ac0-b710-4002ccf88b42 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:40.856597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f254b-49c9-4ac0-b710-4002ccf88b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:40.914718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-562f254b-49c9-4ac0-b710-4002ccf88b42 None None] MFA Rules not processed for user `d38e42db19b34675a217555e0982b9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:40.916332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-562f254b-49c9-4ac0-b710-4002ccf88b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:40.947869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5627192b47484fdeb41b3bf2cc2d713e', 'request_id': 'req-0967d924-8b19-4fe8-998e-a3e33bfceca7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.956093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5627192b47484fdeb41b3bf2cc2d713e', 'request_id': 'req-0967d924-8b19-4fe8-998e-a3e33bfceca7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.969816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5627192b47484fdeb41b3bf2cc2d713e', 'request_id': 'req-0967d924-8b19-4fe8-998e-a3e33bfceca7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.991398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] The token cache is being invalidate because project 5627192b47484fdeb41b3bf2cc2d713e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:40.991684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.992369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:40.994045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1134/2268] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:40 2021] DELETE /identity/v3/projects/5627192b47484fdeb41b3bf2cc2d713e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:40.994903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:40.996423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.031408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1135/2269] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:40 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:41.031408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.031408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.031408 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.076376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d924-8b19-4fe8-998e-a3e33bfceca7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.078861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:41.080930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.084585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.085345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.085621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.085941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] PATH_INFO: `/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.087166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13c14df5cf84a39aded0a35ce1cb4e0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.089176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.098479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1136/2270] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:41.100826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.113135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.209935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13c14df5cf84a39aded0a35ce1cb4e0', 'request_id': 'req-ed8f56da-d7ad-45c6-8546-eb9500a5814c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:41.224923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13c14df5cf84a39aded0a35ce1cb4e0', 'request_id': 'req-ed8f56da-d7ad-45c6-8546-eb9500a5814c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:41.253268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13c14df5cf84a39aded0a35ce1cb4e0', 'request_id': 'req-ed8f56da-d7ad-45c6-8546-eb9500a5814c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:41.279854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb312-38d7-4c7e-8175-2ec64dafc8bd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.293092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] The token cache is being invalidate because project c13c14df5cf84a39aded0a35ce1cb4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:41.293997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:41.297945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ed8f56da-d7ad-45c6-8546-eb9500a5814c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:41.304571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1135/2271] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:40 2021] DELETE /identity/v3/projects/c13c14df5cf84a39aded0a35ce1cb4e0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:41.310008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33e77-8fd7-4092-b594-51ff105df210 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.310660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33e77-8fd7-4092-b594-51ff105df210 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.312158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33e77-8fd7-4092-b594-51ff105df210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.352743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ddf33e77-8fd7-4092-b594-51ff105df210 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:41.354997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ddf33e77-8fd7-4092-b594-51ff105df210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.388999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.390243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.390699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.390904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.394045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.434316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1136/2272] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:41.436689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.437021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.437307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.461555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:41.463432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.472005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.473663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977defc9-58ea-4e00-83d3-3da7ae99942f service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.476817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1137/2273] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:41.478335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.494700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1137/2274] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:41 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:41.495280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfc759-5707-446b-948f-36871c7ba02a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.496086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.496652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.496819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.505087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.506245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.506748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.507212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.508683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:41.509232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.512349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.519490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:41.521734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:41.539118 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1138/2275] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:41.539332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1138/2276] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:41.544888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.545238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.559977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf323033-6474-4678-a525-b3c2dc6c0368 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.561817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808476-0e35-4b93-883b-a00776b40dc2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.567161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.568242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.568706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.569165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.570227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.571336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.572486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.572939 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.573329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.573438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.574819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:41.575449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.578539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.596696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1139/2277] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:41.602568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.620059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1139/2278] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:41.621156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eade1-01d7-42ee-a7db-c24dcab83926 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.624382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.721442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.722293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.722638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.723080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.724292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.726569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.734570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae99f-fdea-42ba-af5d-b45ace0cc4c1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.744208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.745607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.746111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.746611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.747967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.751877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.762870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1140/2279] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:41.770399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.788520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1140/2280] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:41.793190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.807879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5708f-15fc-4dac-a55f-2e8834ee54fe admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.889070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.889836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.890175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.890864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.891822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.894329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.920145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1141/2281] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:41.942003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:41.942311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d642e-a01d-490b-96f7-726f018e0c2d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.949769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.951023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.951023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.951257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.952003 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.960526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a33d5-9a01-45ce-ad5d-923e51bbbdfa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:41.962077 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:41.979315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:41.981123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:41.981767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:41.982425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:41.986009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:41.989649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.024935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1141/2282] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:41 2021] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:42.032386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1142/2283] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:42.034784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.038545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.069098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e628-32ca-478e-9373-69566714ecf8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.070902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7114b-28d6-4992-97c9-d2491359ff19 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.077392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.078484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.078756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.079040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] PATH_INFO: `/v3/projects/6f8f838e6a4647859457e5560571a5ab/users/191079f41ac04162bcb5382c3e872f3c/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.082575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.084175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.085311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.085970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.087252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.090288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.099164 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8f838e6a4647859457e5560571a5ab, user_id=191079f41ac04162bcb5382c3e872f3c, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.102629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247a01b-d032-455e-9b6c-f341c84de3a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.107350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1142/2284] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:42 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:42.108561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.121624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328189c-fc9a-4c34-8d50-9e1d2a6899e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.127666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1143/2285] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:42 2021] PUT /identity/v3/projects/6f8f838e6a4647859457e5560571a5ab/users/191079f41ac04162bcb5382c3e872f3c/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:42.139188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.140007 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.140676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.171911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:42.174113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:42.206776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.207634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.207992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.208334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.209224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.211375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.230113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1143/2286] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:42 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:42.231772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.243374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfd135-7e15-4beb-b8da-f3659e84ff27 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.249035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.249998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.250277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.250551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] PATH_INFO: `/v3/projects/fba74e709efc4241a99f2152915379b9/users/3cb43482f5fb4300b528f0cd8e29d149/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.280187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba74e709efc4241a99f2152915379b9, user_id=3cb43482f5fb4300b528f0cd8e29d149, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.286697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a11a2-4afb-4ad0-9d8d-d30fcd68593e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.300528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1144/2287] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:42.309137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1144/2288] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:42 2021] PUT /identity/v3/projects/fba74e709efc4241a99f2152915379b9/users/3cb43482f5fb4300b528f0cd8e29d149/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:42.313062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.322146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:42.330564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.332271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.332904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.405420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] MFA Rules not processed for user `3cb43482f5fb4300b528f0cd8e29d149`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:42.408340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:42.558197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4849c-402d-4a0f-95ae-f9c45fdb6799 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.627600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1145/2289] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:42 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:42.629225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.688655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.690022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.690772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.692127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.782788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75a40-e1ff-43fe-8c6a-fd048657ada6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.789484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.790393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.790859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.791345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.792394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.795060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.812183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.813842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:42.826463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1145/2290] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:42.835143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1146/2291] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:42 2021] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:42.839398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:42.852373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863484f-e842-4f57-8541-1cca276735c2 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:42.981109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:42.982197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:42.983307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:42.983749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:42.985399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:42.989190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.045688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1146/2292] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:42 2021] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:22:43.051462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.077144 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f8e5c-b3ab-404d-976a-fd0c4d4cb808 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.093027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.095162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.096292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.097124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.099543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:43.107040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262a5b-738b-427a-b5ea-80329465bc35 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.142344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1147/2293] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:43 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:43.147879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.171994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357346ef-8abe-42e1-906a-f2b94f0ff644 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.187760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.188731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.189011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.189354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] PATH_INFO: `/v3/projects/4f6b72a6ca1e495eb141f70fa1635470/users/c7e34d5262a547f1bd1977d35bce2cf2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.199183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.199843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.200492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.228063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b72a6ca1e495eb141f70fa1635470, user_id=c7e34d5262a547f1bd1977d35bce2cf2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:43.234264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.257194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] MFA Rules not processed for user `d38e42db19b34675a217555e0982b9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:43.259365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:43.262360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1147/2294] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:43 2021] PUT /identity/v3/projects/4f6b72a6ca1e495eb141f70fa1635470/users/c7e34d5262a547f1bd1977d35bce2cf2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:43.264068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.437111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57093b3a-8a11-46ff-9401-90d2a37f3949 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.443279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1148/2295] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:43 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:43.446834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.448324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.449426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.450069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.451706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:43.455518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e854d-55d6-4824-afc0-e7171f1634c1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.478835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1148/2296] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:43 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:43.485436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.507979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018892e0-2156-47ad-b2f3-ec9cd6f7bc9f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.518876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.521358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.521827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.522590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] PATH_INFO: `/v3/projects/4f6b72a6ca1e495eb141f70fa1635470/users/c7e34d5262a547f1bd1977d35bce2cf2/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.526714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b72a6ca1e495eb141f70fa1635470, user_id=c7e34d5262a547f1bd1977d35bce2cf2, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:43.532881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.558156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1149/2297] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:43 2021] PUT /identity/v3/projects/4f6b72a6ca1e495eb141f70fa1635470/users/c7e34d5262a547f1bd1977d35bce2cf2/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:43.585494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.586231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.586642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.692707 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] MFA Rules not processed for user `c7e34d5262a547f1bd1977d35bce2cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:43.694079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:43.698260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.700482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:43.827559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3be30-45d2-48e6-9af8-486c2012a012 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.835451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.836743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.837173 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.837549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] PATH_INFO: `/v3/users/8c0f178d8d9f421da853f04df841e2ff` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.839163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0f178d8d9f421da853f04df841e2ff)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:43.841389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:43.849880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1149/2298] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:43 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:43.861754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:43.864490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:43.935639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0f178d8d9f421da853f04df841e2ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:43.937395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0f178d8d9f421da853f04df841e2ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:43.951278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0f178d8d9f421da853f04df841e2ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:43.973692 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd4e50-a4cc-4348-9b39-182271cd7aee None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:43.978537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0f178d8d9f421da853f04df841e2ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:43.979108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:43.979904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:43.980286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:43.981054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:43.993322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-47943f5f-28e6-47f4-ae39-4801528c6d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0f178d8d9f421da853f04df841e2ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:44.000238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:44.004488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:44.008879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1150/2299] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:43 2021] DELETE /identity/v3/users/8c0f178d8d9f421da853f04df841e2ff => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:44.015421 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:44.016036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:44.017176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:44.041604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1150/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:43 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:22:44.066533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:44.069021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:44.216673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1151/2301] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:44.234233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:44.357769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac0d7-e6f3-4a1d-9e48-69cd95084332 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:44.454122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:44.455159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:44.455664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:44.456203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:44.474866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:44.477776 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:44.507229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1151/2302] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:45.151544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:45.159845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:45.196846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:45.199047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:45.199947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b5d9-10e9-4fe3-aee3-3964ffb92e71 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:45.207054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:45.208280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:45.208605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:45.209669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] PATH_INFO: `/v3/projects/7be3060402d04be3b1b6c9f29c4d7869` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:45.212661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be3060402d04be3b1b6c9f29c4d7869)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:45.218022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:45.226041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ee0f0-ab67-4b2e-a361-9af310e1e86c service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:45.242425 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:45.243349 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:45.246280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:45.246829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] PATH_INFO: `/v3/users/3cb43482f5fb4300b528f0cd8e29d149` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:45.249214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb43482f5fb4300b528f0cd8e29d149)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:45.256888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:45.323127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be3060402d04be3b1b6c9f29c4d7869', 'request_id': 'req-79dc73e4-9940-4034-803f-8563e81b34fd'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.334767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb43482f5fb4300b528f0cd8e29d149'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.348089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be3060402d04be3b1b6c9f29c4d7869', 'request_id': 'req-79dc73e4-9940-4034-803f-8563e81b34fd'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.359388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be3060402d04be3b1b6c9f29c4d7869', 'request_id': 'req-79dc73e4-9940-4034-803f-8563e81b34fd'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.377452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb43482f5fb4300b528f0cd8e29d149'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.381732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] The token cache is being invalidate because project 7be3060402d04be3b1b6c9f29c4d7869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:45.382417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.385298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.390088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1152/2303] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:45 2021] DELETE /identity/v3/projects/7be3060402d04be3b1b6c9f29c4d7869 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:45.395554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:45.398236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:45.398490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb43482f5fb4300b528f0cd8e29d149'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.421188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb43482f5fb4300b528f0cd8e29d149'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.425232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-63ba0ba3-6257-4484-9f71-62f5268c51cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb43482f5fb4300b528f0cd8e29d149'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.450231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1152/2304] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:45 2021] DELETE /identity/v3/users/3cb43482f5fb4300b528f0cd8e29d149 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:22:45.463842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:45.465107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:45.466411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:45.522426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:45.525355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:45.624867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc73e4-9940-4034-803f-8563e81b34fd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:45.628641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1153/2305] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:45.645695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:45.646620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:45.646899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:45.647223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] PATH_INFO: `/v3/users/10b401b377e7446eaed3600396b3afa2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:45.651458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:45.651665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b401b377e7446eaed3600396b3afa2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:45.653461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:45.668457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:45.810660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9153c7-49dd-41bf-a73f-faa5092c8e4f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:45.810949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b401b377e7446eaed3600396b3afa2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.811951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b401b377e7446eaed3600396b3afa2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.820171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:45.821152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:45.821469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:45.821897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:45.834440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b401b377e7446eaed3600396b3afa2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.856017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:45.857633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:45.874260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b401b377e7446eaed3600396b3afa2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.881608 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1154/2306] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:45.893220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b401b377e7446eaed3600396b3afa2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:45.912898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1153/2307] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:45 2021] DELETE /identity/v3/users/10b401b377e7446eaed3600396b3afa2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:47.785761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:47.787892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:47.803126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8c77a-fd46-4580-add1-3ee04cfdf1bd service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:48.023454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:48.025067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.025615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.026135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] PATH_INFO: `/v3/projects/3385eb5de1604d8587bb009ce1c265f6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.036239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3385eb5de1604d8587bb009ce1c265f6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:48.041437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:48.141363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3385eb5de1604d8587bb009ce1c265f6', 'request_id': 'req-7448d913-0563-4594-8d43-c4658265efb4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.143470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:48.147504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:48.164041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3385eb5de1604d8587bb009ce1c265f6', 'request_id': 'req-7448d913-0563-4594-8d43-c4658265efb4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.180121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3385eb5de1604d8587bb009ce1c265f6', 'request_id': 'req-7448d913-0563-4594-8d43-c4658265efb4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.182202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d9402-af32-4ad9-9e01-facdc462653e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:48.214720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] The token cache is being invalidate because project 3385eb5de1604d8587bb009ce1c265f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:48.215364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.217038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7448d913-0563-4594-8d43-c4658265efb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.229039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1155/2308] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:47 2021] DELETE /identity/v3/projects/3385eb5de1604d8587bb009ce1c265f6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:48.233153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782eeb4-2956-430e-8373-ecd440066efc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.234694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782eeb4-2956-430e-8373-ecd440066efc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.234694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782eeb4-2956-430e-8373-ecd440066efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.270514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1782eeb4-2956-430e-8373-ecd440066efc None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:48.274645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1782eeb4-2956-430e-8373-ecd440066efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:48.314835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:48.318410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.318654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.320457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] PATH_INFO: `/v3/projects/fba74e709efc4241a99f2152915379b9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.323450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba74e709efc4241a99f2152915379b9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:48.329581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:48.369398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1156/2309] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:48.371742 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.372286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.372779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.397975 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:48.399760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:48.417414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1157/2310] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:48.420333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:48.434566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91429e5f-970f-4eaf-998c-a64b1f4a869e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:48.441399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:48.442595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.442964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.443415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.445150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:48.445150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:48.447582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:48.469577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1158/2311] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:48.470902 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:48.488695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb351f-f504-4375-9b5b-7989065a3fe1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:48.507250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba74e709efc4241a99f2152915379b9', 'request_id': 'req-69b911fa-28e7-4eb0-933d-d5e75ae46b49'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.523393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba74e709efc4241a99f2152915379b9', 'request_id': 'req-69b911fa-28e7-4eb0-933d-d5e75ae46b49'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.542506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba74e709efc4241a99f2152915379b9', 'request_id': 'req-69b911fa-28e7-4eb0-933d-d5e75ae46b49'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.583301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] The token cache is being invalidate because project fba74e709efc4241a99f2152915379b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:48.585138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.590812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:48.604558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1154/2312] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:48 2021] DELETE /identity/v3/projects/fba74e709efc4241a99f2152915379b9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:48.607057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:48.610898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:48.638420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:48.639887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:48.640189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:48.640641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:48.644262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:48.648672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:48.725906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1159/2313] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:48 2021] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:48.731528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:48.738331 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:48.888822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b911fa-28e7-4eb0-933d-d5e75ae46b49 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:49.057538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75411a-f6f1-4209-9b56-c4e821f903b3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:49.093795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:49.095099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.095953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.096577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.098061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:49.101720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:49.145644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:49.148499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.148986 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.150886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] PATH_INFO: `/v3/users/c7e34d5262a547f1bd1977d35bce2cf2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.153477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e34d5262a547f1bd1977d35bce2cf2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:49.160172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:49.164869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1160/2314] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:48 2021] POST /identity/v3/users => generated 289 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:49.169038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:49.188673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d97b-c7d4-408f-8ab4-511d779f7a73 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:49.204722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:49.204722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.205037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.205207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.206160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:49.208198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:49.247328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1161/2315] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:49.254865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:49.328220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c039b9-b686-4efe-94ad-657f7d50df55 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:49.354990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e34d5262a547f1bd1977d35bce2cf2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:49.364195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e34d5262a547f1bd1977d35bce2cf2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:49.369050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:49.370355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.370852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.371334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.382738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:49.391940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:49.421842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e34d5262a547f1bd1977d35bce2cf2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:49.483650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1162/2316] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:49.492864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:49.497944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e34d5262a547f1bd1977d35bce2cf2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:49.523377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d12c1-b5ec-4b9d-b604-557c50831214 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:49.536914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f808577a-6cc4-49fc-86f2-04352f634490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e34d5262a547f1bd1977d35bce2cf2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:49.546280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:49.548043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.548644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.549075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] PATH_INFO: `/v3/projects/957762994fcf412c86ef5c0f14997d1e/users/c6266f6d62c1494ba84169c9683e567b/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.563076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1155/2317] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:48 2021] DELETE /identity/v3/users/c7e34d5262a547f1bd1977d35bce2cf2 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:49.592221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957762994fcf412c86ef5c0f14997d1e, user_id=c6266f6d62c1494ba84169c9683e567b, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:49.597696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:49.637584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1163/2318] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:49 2021] PUT /identity/v3/projects/957762994fcf412c86ef5c0f14997d1e/users/c6266f6d62c1494ba84169c9683e567b/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:49.654749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:49.655145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:49.655546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:49.710470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] MFA Rules not processed for user `c6266f6d62c1494ba84169c9683e567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:49.712026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:49.847763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1156/2319] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:49.854732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:49.857424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:49.993009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec798a42-dc28-4600-a8f3-89de97f45ee7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:50.000009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:50.003082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:50.003807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:50.003807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:50.022040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:50.025131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99085adc-5bc9-4834-88e6-b1b82071fdcd service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:50.049071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1164/2320] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:49 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:50.738594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:50.741296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:51.040370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78aa32-ce0c-4907-9695-b27a3a2b6d03 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:51.061245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:51.063869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:51.064764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:51.065884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] PATH_INFO: `/v3/projects/4f6b72a6ca1e495eb141f70fa1635470` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:51.073736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6b72a6ca1e495eb141f70fa1635470)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:51.084825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:51.207703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6b72a6ca1e495eb141f70fa1635470', 'request_id': 'req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:51.228191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6b72a6ca1e495eb141f70fa1635470', 'request_id': 'req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:51.242671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6b72a6ca1e495eb141f70fa1635470', 'request_id': 'req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:51.272748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] The token cache is being invalidate because project 4f6b72a6ca1e495eb141f70fa1635470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:51.275447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:51.275880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d2ebaf7e-4cf3-4baa-a882-423d27e535a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:51.286316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1157/2321] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:50 2021] DELETE /identity/v3/projects/4f6b72a6ca1e495eb141f70fa1635470 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:51.289232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:51.291123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:51.291430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:51.361820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:51.363446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:51.585049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:51.585567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:51.586035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:51.589673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1165/2322] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:51.635207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:51.637917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:51.684273 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1158/2323] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:51.692875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:51.731315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5f97-9b67-4cc3-83a8-d5f07b8dc2d0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:51.754144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:51.759090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:51.759491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:51.759763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:51.760630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:51.760946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:51.771178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:51.848639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1166/2324] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:51.854325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:51.880328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98110475-a46d-432b-89a2-eb6d09f2ccab None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:51.889399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:51.891008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:51.891844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:51.892639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:51.902136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:51.906390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:51.974878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1159/2325] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:51 2021] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:51.975136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:51.998358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ee75-99f8-4916-b7c3-4d145ef1a1e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:52.141439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:52.142612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:52.142612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:52.142612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:52.143533 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:52.151054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:52.198080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1167/2326] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:51 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:52.206045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:52.239630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda66f-6d5e-4112-8e9a-a1c7d790b41f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:52.273303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:52.274447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:52.274928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:52.275414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:52.277381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:52.280079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:52.308358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1160/2327] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:52 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:52.309578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:52.327232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2bbb-057c-4bfd-a740-af159a3d028a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:52.335947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:52.337755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:52.338640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:52.339527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:52.341239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:52.345025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6600e7-eebe-402c-8fdd-53a76799d1d2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:52.373149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:52.374221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1168/2328] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:52 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:22:52.395985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e612ed-824d-451a-b348-8faeaa6d725a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:52.418904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:52.421616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:52.422919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:52.425464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] PATH_INFO: `/v3/projects/f56ca64339c84d819c670f5365c7ddf5/users/7542a2ab73704179b16dddbdfabf5cd7/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:52.491751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ca64339c84d819c670f5365c7ddf5, user_id=7542a2ab73704179b16dddbdfabf5cd7, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:52.505330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:52.595859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1161/2329] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:52 2021] PUT /identity/v3/projects/f56ca64339c84d819c670f5365c7ddf5/users/7542a2ab73704179b16dddbdfabf5cd7/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:52.599485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120050c3-d3c4-466e-b775-c8efe3d14a89 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:52.600042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120050c3-d3c4-466e-b775-c8efe3d14a89 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:52.600408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120050c3-d3c4-466e-b775-c8efe3d14a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:52.741740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-120050c3-d3c4-466e-b775-c8efe3d14a89 None None] MFA Rules not processed for user `7542a2ab73704179b16dddbdfabf5cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:52.743012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-120050c3-d3c4-466e-b775-c8efe3d14a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:52.911861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1169/2330] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:52.924040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.329943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e76b2e-35a3-4afd-8e6a-f19e1c6a5919 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:53.357695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:53.359250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.359969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.361675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.364054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:53.376669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:53.457971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925d15-6edc-4764-817c-276561872540 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.458839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925d15-6edc-4764-817c-276561872540 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.458991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925d15-6edc-4764-817c-276561872540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.473289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1162/2331] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:52 2021] POST /identity/v3/projects => generated 383 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:53.475686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.553745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d6925d15-6edc-4764-817c-276561872540 None None] MFA Rules not processed for user `191079f41ac04162bcb5382c3e872f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:53.555927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d6925d15-6edc-4764-817c-276561872540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:53.676401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28baf-f73f-48cf-b309-f55ec77762ee admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:53.688995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:53.691208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.695892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.696511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.697777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:53.700148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:53.752507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1163/2332] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:53 2021] POST /identity/v3/users => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:53.755163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.771289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ca45-a2a4-4c14-bc32-103456f85ce1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:53.777726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:53.778577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.778918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.779250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.780107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:53.782095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:53.806846 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1164/2333] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:53.808543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.817498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1170/2334] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:53.830241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925d15-6edc-4764-817c-276561872540 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.833364 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d6925d15-6edc-4764-817c-276561872540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:53.837581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93cc4-f7b0-485f-8b9d-a495b609eecb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:53.848265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:53.849263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.849543 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.849821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] PATH_INFO: `/v3/projects/ce31d999deeb45dea6f13e333a9fead9/users/6e6de8db983a494b9e90cd884e5054d4/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.867463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925d15-6edc-4764-817c-276561872540 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:53.871893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce31d999deeb45dea6f13e333a9fead9, user_id=6e6de8db983a494b9e90cd884e5054d4, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:53.873902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:53.896339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:53.897871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:53.898462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:53.902164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1165/2335] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:53 2021] PUT /identity/v3/projects/ce31d999deeb45dea6f13e333a9fead9/users/6e6de8db983a494b9e90cd884e5054d4/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:53.905311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:53.906457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:53.908624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:53.911586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:53.990330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1171/2336] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:53 2021] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:53.994793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.100973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab35250-fe34-4d3c-adaf-404645eb90a8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.226465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb9fd-4cbc-409b-aa7a-cf06d5316d10 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.237820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.240185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.241077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.241931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.243423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.248854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.304324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1172/2337] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:53 2021] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:54.306933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.333981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b445-a561-41dd-bb8a-9bf020fe78ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.342207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.343534 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.344678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.345179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.346736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.350565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.371055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.372624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.372763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.373271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.374768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.378973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.384800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1173/2338] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:54 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:54.388410 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.403055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1166/2339] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:54.407892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.410556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb86288-ff74-4a4c-afa6-317acfcd46ce admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.419602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.421697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.422454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.423092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] PATH_INFO: `/v3/projects/bbe900a67c3c49978e14aa8b229eea8a/users/ff6ea81405f0427282cec54854bcef12/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.450647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3dcb-f667-4ccb-9a22-1fffeb842fcd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.460422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.461400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.461727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.462054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] PATH_INFO: `/v3/projects/ce31d999deeb45dea6f13e333a9fead9/users/6e6de8db983a494b9e90cd884e5054d4/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.465358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce31d999deeb45dea6f13e333a9fead9, user_id=6e6de8db983a494b9e90cd884e5054d4, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.470450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe900a67c3c49978e14aa8b229eea8a, user_id=ff6ea81405f0427282cec54854bcef12, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.474066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.477086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749e2fe-8df0-4e9e-8d6b-83298052219a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.503717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1174/2341] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:54 2021] PUT /identity/v3/projects/bbe900a67c3c49978e14aa8b229eea8a/users/ff6ea81405f0427282cec54854bcef12/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:54.505110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.507783 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1167/2341] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:54 2021] PUT /identity/v3/projects/ce31d999deeb45dea6f13e333a9fead9/users/6e6de8db983a494b9e90cd884e5054d4/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:54.510889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.510889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.510889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.561674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] MFA Rules not processed for user `6e6de8db983a494b9e90cd884e5054d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:54.562903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:54.674934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6935d9-4687-4618-8329-f15afc308c4f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.681494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.682197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.682636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.682915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.683694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.685615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.697708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1168/2342] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:54 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:22:54.709520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1175/2343] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:54 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:54.711318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.711997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:54.714881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:54.726507 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3b55c-adfc-4a52-810e-96dde91b692b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.732160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.733304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.733589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.734004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] PATH_INFO: `/v3/projects/bbe900a67c3c49978e14aa8b229eea8a/users/ff6ea81405f0427282cec54854bcef12/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:54.738062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe900a67c3c49978e14aa8b229eea8a, user_id=ff6ea81405f0427282cec54854bcef12, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:54.743732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:54.764974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1169/2344] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:22:54 2021] PUT /identity/v3/projects/bbe900a67c3c49978e14aa8b229eea8a/users/ff6ea81405f0427282cec54854bcef12/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:54.817637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925e75-5e08-46c1-8b20-9ceaf78f0186 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:54.953366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:54.954541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:54.954942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:54.955429 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:55.100627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:55.102152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:55.117367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1176/2345] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:54 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:55.224637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:55.240194 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ede97-3470-47b4-aac9-75ea612acbd0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:55.267235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:55.271464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:55.272532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:55.278016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:55.566575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:55.568387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108aaea4-7d20-491d-8a47-5dcbe70b6a0f service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:55.591735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1170/2346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:55 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:56.348396 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:56.563495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d331-669c-48b8-a44f-ea4893321126 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:56.584788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:56.588716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:56.589329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:56.590129 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] PATH_INFO: `/v3/users/7542a2ab73704179b16dddbdfabf5cd7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:56.592307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7542a2ab73704179b16dddbdfabf5cd7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:56.595845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:56.689495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7542a2ab73704179b16dddbdfabf5cd7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:56.730028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7542a2ab73704179b16dddbdfabf5cd7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:56.754501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7542a2ab73704179b16dddbdfabf5cd7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:56.766510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7542a2ab73704179b16dddbdfabf5cd7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:56.767482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7542a2ab73704179b16dddbdfabf5cd7'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:56.777480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1177/2347] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:56 2021] DELETE /identity/v3/users/7542a2ab73704179b16dddbdfabf5cd7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:56.784488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:56.785994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:56.786688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:56.813309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:56.815815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:56.979158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1171/2348] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:56.991628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:56.993380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:57.081201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42123-139a-434d-95cf-c425f73d1f21 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:57.086251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:57.087889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:57.088226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:57.088634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:57.100907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:57.102678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:57.118876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1178/2349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:57.731618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:57.733220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:57.756990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b4eb8-a604-4316-83eb-16fe24d3be33 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:57.776152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:57.778363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:57.779152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:57.779694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] PATH_INFO: `/v3/projects/f56ca64339c84d819c670f5365c7ddf5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:57.782284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56ca64339c84d819c670f5365c7ddf5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:57.790069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:57.943725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56ca64339c84d819c670f5365c7ddf5', 'request_id': 'req-4bb48851-05d2-4833-aa68-2064db1faf31'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:57.962576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56ca64339c84d819c670f5365c7ddf5', 'request_id': 'req-4bb48851-05d2-4833-aa68-2064db1faf31'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:57.981399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56ca64339c84d819c670f5365c7ddf5', 'request_id': 'req-4bb48851-05d2-4833-aa68-2064db1faf31'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.016740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] The token cache is being invalidate because project f56ca64339c84d819c670f5365c7ddf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:58.017684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.020751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.033289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1172/2350] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:57 2021] DELETE /identity/v3/projects/f56ca64339c84d819c670f5365c7ddf5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:58.040491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:58.061333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10010-6901-4442-be66-0bd8934fc2d9 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:58.176695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:58.177669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:58.178032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:58.178319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] PATH_INFO: `/v3/users/6e6de8db983a494b9e90cd884e5054d4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:58.179998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6de8db983a494b9e90cd884e5054d4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:58.183128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:58.259123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6de8db983a494b9e90cd884e5054d4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.279200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6de8db983a494b9e90cd884e5054d4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.291097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6de8db983a494b9e90cd884e5054d4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.312328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6de8db983a494b9e90cd884e5054d4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.314166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8ebb77ad-c48b-46ee-be5c-6f8091945173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6de8db983a494b9e90cd884e5054d4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.326443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1179/2351] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:22:58 2021] DELETE /identity/v3/users/6e6de8db983a494b9e90cd884e5054d4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:58.676614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:58.678771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:58.696619 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48851-05d2-4833-aa68-2064db1faf31 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:58.837434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:58.839475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:58.839995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:58.840567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] PATH_INFO: `/v3/projects/ce31d999deeb45dea6f13e333a9fead9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:58.842248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce31d999deeb45dea6f13e333a9fead9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:58.845312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:58.935050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce31d999deeb45dea6f13e333a9fead9', 'request_id': 'req-52d791c9-555d-40c1-83fe-4602eeda693f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.961764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce31d999deeb45dea6f13e333a9fead9', 'request_id': 'req-52d791c9-555d-40c1-83fe-4602eeda693f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:58.970871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce31d999deeb45dea6f13e333a9fead9', 'request_id': 'req-52d791c9-555d-40c1-83fe-4602eeda693f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:59.011119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] The token cache is being invalidate because project ce31d999deeb45dea6f13e333a9fead9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:22:59.012879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:59.013761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52d791c9-555d-40c1-83fe-4602eeda693f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:22:59.015843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1173/2352] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:22:58 2021] DELETE /identity/v3/projects/ce31d999deeb45dea6f13e333a9fead9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:22:59.024270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.024270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.024598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.129161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:59.135688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:59.329744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1180/2353] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:59.337881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.338158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.338422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.403147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:59.404593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:59.455635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1174/2354] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:22:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:59.460035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:59.483969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ba0d-973f-4576-8105-8fae77b1521b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:59.496922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:59.497677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.497910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.498171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.499126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:22:59.500953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:59.505389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:59.540099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1181/2355] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:22:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:22:59.540537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:59.550705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d527248-9a83-4441-a04f-bfd806dba4a1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:59.565062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:59.565850 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.566131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.566602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.567365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:59.574008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:59.672835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1175/2356] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:22:59 2021] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:59.679702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:59.698500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384430-4b18-4369-b7ed-dd60ad4eb85a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:59.817734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:59.818515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.818798 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.819074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.819834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:59.822411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:59.863568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1182/2357] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:22:59 2021] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:22:59.868235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:59.901287 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133e14-a75d-4040-b88b-d5589e412082 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:59.918763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:59.919876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:59.920462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:59.920897 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:59.922955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:59.935358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:59.980418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1176/2358] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:59 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:22:59.985919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:00.019441 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff8c11-aecb-4216-8e54-bcec46903e26 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:00.030924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:00.032868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:00.032868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:00.033105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:00.035222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:00.038486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f361d0-891c-4e98-84d3-86f227bb4888 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:00.064765 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1183/2359] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:22:59 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:00.068662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:00.103566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5d35-5d03-43c8-9d59-25d174a1f39d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:00.148950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:00.150522 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:00.150999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:00.151474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] PATH_INFO: `/v3/projects/08220109b3c5408e97a19d4d49b4e426/users/950d8946edf342e291daf7b6b6750f26/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:00.226438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=08220109b3c5408e97a19d4d49b4e426, user_id=950d8946edf342e291daf7b6b6750f26, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:00.239290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:00.313348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1177/2360] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:00 2021] PUT /identity/v3/projects/08220109b3c5408e97a19d4d49b4e426/users/950d8946edf342e291daf7b6b6750f26/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:23:00.331092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:00.331980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:00.332808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:00.461416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] MFA Rules not processed for user `950d8946edf342e291daf7b6b6750f26`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:00.463080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:00.707390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:00.708240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1184/2361] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:00.967726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dc29-9f45-4d4b-a1e3-d7769db85bac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:00.983525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:00.984240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:00.984551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:00.984837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:00.985812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:00.989211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:01.098256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1178/2362] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:23:00 2021] POST /identity/v3/projects => generated 375 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:01.104095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:01.165801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56984d-f1ec-4d2e-b0f9-9cd502241358 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:01.375329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:01.376321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:01.376321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:01.376647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:01.377604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:01.382886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:01.437647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1185/2363] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:23:01 2021] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:01.443372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:01.459564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd3e5-e442-483c-95de-c3d5fd6f43c8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:01.476645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:01.477353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:01.483784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:01.484587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:01.487212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:01.492707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:01.524596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1179/2364] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:01.527682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:01.544553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7319-37d0-4e3f-9c4c-6ddcae98839b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:01.558788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:01.559979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:01.561732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:01.563833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:01.564970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:01.570367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615522-d16c-45a1-b4da-116bf288c79a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:01.598998 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1186/2365] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:23:01.605111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:01.637941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e37e6-3f64-4b99-90e9-997081506e32 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:01.666823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:01.668893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:01.669410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:01.669864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] PATH_INFO: `/v3/projects/e9aa74b2972a4cfab95bb9cff59175ed/users/cc75117aac1c4e55a44a4ce2d0dec087/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:01.735297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9aa74b2972a4cfab95bb9cff59175ed, user_id=cc75117aac1c4e55a44a4ce2d0dec087, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:01.738969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:01.781740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1180/2366] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:01 2021] PUT /identity/v3/projects/e9aa74b2972a4cfab95bb9cff59175ed/users/cc75117aac1c4e55a44a4ce2d0dec087/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:01.802249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:01.803502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:01.803502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:01.923232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] MFA Rules not processed for user `cc75117aac1c4e55a44a4ce2d0dec087`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:01.924976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:02.188637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1187/2367] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:02.195209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:02.483576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20401-baa9-4ff2-a96a-a48866d4cddb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:02.503010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:02.505293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:02.505753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:02.508648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:02.512188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:02.518938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:02.609621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1181/2368] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:23:02 2021] POST /identity/v3/projects => generated 377 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:23:02.612841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:02.666884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942d6cf-119b-40d6-9fa2-03bcdb1014ef None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:02.945746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:02.947063 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:02.947516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:02.947938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:02.948909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:02.951183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:03.000827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1188/2369] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:23:02 2021] POST /identity/v3/users => generated 295 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:03.006477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:03.022479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdfb67-7e04-48d8-bac2-b240a150fbe1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:03.037392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:03.037924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:03.038205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:03.038482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:03.039264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:03.041056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:03.072803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1182/2370] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:23:03.090796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:03.139361 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e84f74-5bcf-4a2c-8c48-f2046488cbae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:03.166856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:03.168506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:03.169106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:03.169447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] PATH_INFO: `/v3/projects/c5292660e54f4fbca66726c2f86ab327/users/fc3c42f4ac854bb68cf9b0df368e4805/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:03.222202 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5292660e54f4fbca66726c2f86ab327, user_id=fc3c42f4ac854bb68cf9b0df368e4805, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:03.233291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:03.287854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1189/2371] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:03 2021] PUT /identity/v3/projects/c5292660e54f4fbca66726c2f86ab327/users/fc3c42f4ac854bb68cf9b0df368e4805/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:23:03.296785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:03.320975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa299b9e-ab32-4958-8e08-d7c912bd31d0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:03.489969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:03.491536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:03.492256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:03.493833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:03.495790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:03.499750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a342a1-d29c-4a88-b3f9-e16242ef0d60 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:03.528821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1183/2372] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:03 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:03.532922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:03.557695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4219-86b4-4c18-a56d-9d99ad0eabfc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:03.581182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:03.582189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:03.582794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:03.583162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] PATH_INFO: `/v3/projects/c5292660e54f4fbca66726c2f86ab327/users/fc3c42f4ac854bb68cf9b0df368e4805/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:03.593002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5292660e54f4fbca66726c2f86ab327, user_id=fc3c42f4ac854bb68cf9b0df368e4805, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:03.604105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:03.640306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1190/2373] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:03 2021] PUT /identity/v3/projects/c5292660e54f4fbca66726c2f86ab327/users/fc3c42f4ac854bb68cf9b0df368e4805/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:03.659382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb431-a7e5-4649-ad55-a0b6963e274b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:03.659922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb431-a7e5-4649-ad55-a0b6963e274b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:03.660405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb431-a7e5-4649-ad55-a0b6963e274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:03.743751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-580cb431-a7e5-4649-ad55-a0b6963e274b None None] MFA Rules not processed for user `fc3c42f4ac854bb68cf9b0df368e4805`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:03.745962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-580cb431-a7e5-4649-ad55-a0b6963e274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:03.925810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1184/2374] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:03 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:03.948376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:03.951411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:04.136529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6fb85-fad6-4ddd-804c-10b364beffc2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:04.144553 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:04.146169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:04.146881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:04.147576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:04.337066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:04.338386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:04.352875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1191/2375] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:03 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:05.894557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:05.895359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:05.895359 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:05.941739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] MFA Rules not processed for user `ff6ea81405f0427282cec54854bcef12`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:05.943140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:06.051270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1185/2376] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:05 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:06.277554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:06.284379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:06.375395 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967cbd-9f80-4682-9c9b-4601fa1f8d13 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:06.382994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:06.384136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:06.384676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:06.385153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:06.388286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:06.482217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:06.484128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0c15-c9e5-4903-ae45-e88dde5a163e service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:06.498355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1192/2377] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:08.504249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:08.523238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bfaaf-2307-4cdb-9dd0-b89c96d0b79d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:08.532687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:08.533720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:08.534713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:08.535564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:08.683082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:08.685710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:08.699090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1186/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:08 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:09.309312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:09.310494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:09.311124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:09.378643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] MFA Rules not processed for user `191079f41ac04162bcb5382c3e872f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:09.389445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:09.423717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1193/2379] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:09.933993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:09.935679 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:09.950887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f62d-682d-4d2b-9501-34ac923f47d7 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:09.955500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:09.957279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:09.957574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:09.957851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:09.972317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:09.974691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d2d4-dce4-41c1-a8d7-8228fdeae453 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:10.000417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1187/2380] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:09 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:13.782904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:13.785402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:13.889847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c2d23-9e55-4bcb-99c7-a7ab772cb37e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:13.895952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:13.896907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:13.897194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:13.897660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] PATH_INFO: `/v3/users/c6266f6d62c1494ba84169c9683e567b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:13.898953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6266f6d62c1494ba84169c9683e567b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:13.901055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:13.988746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6266f6d62c1494ba84169c9683e567b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.008574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6266f6d62c1494ba84169c9683e567b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.021428 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6266f6d62c1494ba84169c9683e567b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.031318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6266f6d62c1494ba84169c9683e567b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.032326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6266f6d62c1494ba84169c9683e567b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.041862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1194/2381] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:23:13 2021] DELETE /identity/v3/users/c6266f6d62c1494ba84169c9683e567b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:14.048085 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:14.049031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:14.049312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:14.080286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:14.082568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:14.186919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1188/2382] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:14.199066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:14.201336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:14.325150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a690e-70b7-4265-a5d2-6542d735182f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:14.332570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:14.333957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:14.334468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:14.335040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:14.351675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:14.354606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7059a9-498c-4370-9d80-4383ba05557c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:14.369316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1195/2383] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:14.546197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:14.550234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:14.573827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d032-712d-44ad-8fd2-b0df5086337d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:14.583156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:14.584919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:14.585490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:14.586053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] PATH_INFO: `/v3/users/950d8946edf342e291daf7b6b6750f26` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:14.588542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=950d8946edf342e291daf7b6b6750f26)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:14.592529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:14.715367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950d8946edf342e291daf7b6b6750f26'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.716094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950d8946edf342e291daf7b6b6750f26'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.725684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950d8946edf342e291daf7b6b6750f26'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.756804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950d8946edf342e291daf7b6b6750f26'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.776026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950d8946edf342e291daf7b6b6750f26'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:14.795845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1189/2384] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:23:14 2021] DELETE /identity/v3/users/950d8946edf342e291daf7b6b6750f26 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:14.803880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:14.804582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:14.804732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:14.875047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:14.877993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:15.041312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1196/2385] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:15.059782 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.061902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:15.164354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.166736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:15.217226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7816f-550b-49ea-8117-bd77ffdc33e1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.225532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3d64-d389-4540-a04a-984d95a5c0fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.225990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.227477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.227951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.228445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] PATH_INFO: `/v3/projects/957762994fcf412c86ef5c0f14997d1e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.230834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957762994fcf412c86ef5c0f14997d1e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.238273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.250208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.258545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.259363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.260230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.285116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.288401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6fd5-a284-4fac-9ef1-3a313d2cc4af service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.316032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1190/2386] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:23:15.341638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957762994fcf412c86ef5c0f14997d1e', 'request_id': 'req-55ea0496-3dc4-4c9e-971c-59f72f422fb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:15.351061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957762994fcf412c86ef5c0f14997d1e', 'request_id': 'req-55ea0496-3dc4-4c9e-971c-59f72f422fb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:15.367691 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957762994fcf412c86ef5c0f14997d1e', 'request_id': 'req-55ea0496-3dc4-4c9e-971c-59f72f422fb3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:15.392165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] The token cache is being invalidate because project 957762994fcf412c86ef5c0f14997d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:23:15.392471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:15.393234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-55ea0496-3dc4-4c9e-971c-59f72f422fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:15.395832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1197/2387] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:23:15 2021] DELETE /identity/v3/projects/957762994fcf412c86ef5c0f14997d1e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:15.403810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31290-5b58-4fff-b256-734068a7589e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.404093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31290-5b58-4fff-b256-734068a7589e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.404360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31290-5b58-4fff-b256-734068a7589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.427000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-94d31290-5b58-4fff-b256-734068a7589e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:15.428316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-94d31290-5b58-4fff-b256-734068a7589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:15.529031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1191/2388] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:15.545369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.545739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.546150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.572990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:15.574279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:15.583589 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1198/2389] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:15.589304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d31290-5b58-4fff-b256-734068a7589e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.607860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d31290-5b58-4fff-b256-734068a7589e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.615978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.617297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.617727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.618207 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.619668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:23:15.620199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.623351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.648915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1192/2390] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:23:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:23:15.650601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.663378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bb392-9564-4ae9-80e0-553fe1b47047 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.670896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.674054 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.674997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.675750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.678251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.682292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.740817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1199/2391] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:23:15 2021] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:15.748484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.769435 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae12-e6f9-4b3f-b22a-0cda38adc21b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.887184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.888184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.888896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.890997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.890997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.893341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.931108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1193/2392] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:23:15 2021] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:15.935867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:15.950111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d2d0-bc53-4d1f-9b1f-42b55e5fc812 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:15.955634 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:15.957498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:15.957910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:15.958290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:15.959217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:15.961192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:15.984868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1200/2393] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:15.990972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:16.028997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4230d-76a6-42ab-86b0-8f2cef136c6e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:16.028997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:16.032567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:16.032567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:16.032567 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:16.034947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:16.038411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e191763-5173-4dc6-a305-4b8c07180351 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:16.063466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1194/2394] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:16.068298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:16.079094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f177-d2e4-41c5-bdfe-13941e2748ba admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:16.087150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:16.088169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:16.088888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:16.089178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] PATH_INFO: `/v3/projects/2ce9eb0396d945e692eb72ae3f344a66/users/525625cf3f3a4381a828f58b8ac056f3/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:16.139990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce9eb0396d945e692eb72ae3f344a66, user_id=525625cf3f3a4381a828f58b8ac056f3, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:16.139990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:16.158609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1201/2395] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:16 2021] PUT /identity/v3/projects/2ce9eb0396d945e692eb72ae3f344a66/users/525625cf3f3a4381a828f58b8ac056f3/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:16.165655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:16.166260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:16.166861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:16.208022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:16.209916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:16.303013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1195/2396] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:16.312402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:16.317423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:16.432401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275524e-91ab-4203-9b35-523b6bbf5502 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:16.437318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:16.438311 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:16.438605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:16.439030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:16.454531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:16.457226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:16.471606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1202/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:16.586478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:16.589231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:16.630227 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942350c-7312-43fa-947b-185ecf7c05dc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:16.640047 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:16.642664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:16.643091 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:16.643642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] PATH_INFO: `/v3/projects/08220109b3c5408e97a19d4d49b4e426` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:16.646218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08220109b3c5408e97a19d4d49b4e426)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:16.649764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:16.744688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08220109b3c5408e97a19d4d49b4e426', 'request_id': 'req-d440c2d0-1eba-49f4-b36e-148dba9a84d5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:16.763930 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08220109b3c5408e97a19d4d49b4e426', 'request_id': 'req-d440c2d0-1eba-49f4-b36e-148dba9a84d5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:16.773154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08220109b3c5408e97a19d4d49b4e426', 'request_id': 'req-d440c2d0-1eba-49f4-b36e-148dba9a84d5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:16.815060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] The token cache is being invalidate because project 08220109b3c5408e97a19d4d49b4e426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:23:16.815553 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:16.817596 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-d440c2d0-1eba-49f4-b36e-148dba9a84d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:16.831184 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1196/2398] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:23:16 2021] DELETE /identity/v3/projects/08220109b3c5408e97a19d4d49b4e426 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:16.833267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:16.849917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef69075-1c1d-4c44-b067-2bbf0b4f020a service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:17.037703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:17.039563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:17.041165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:17.041722 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] PATH_INFO: `/v3/users/cc75117aac1c4e55a44a4ce2d0dec087` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:17.043654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc75117aac1c4e55a44a4ce2d0dec087)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:17.047783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:17.135048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc75117aac1c4e55a44a4ce2d0dec087'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:17.163513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc75117aac1c4e55a44a4ce2d0dec087'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:17.180859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc75117aac1c4e55a44a4ce2d0dec087'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:17.192182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc75117aac1c4e55a44a4ce2d0dec087'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:17.193986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc75117aac1c4e55a44a4ce2d0dec087'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:17.207368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1203/2399] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:23:16 2021] DELETE /identity/v3/users/cc75117aac1c4e55a44a4ce2d0dec087 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:18.071347 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:18.072174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:18.072174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:18.147858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:18.149550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:18.160688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] MFA Rules not processed for user `525625cf3f3a4381a828f58b8ac056f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:18.167612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:18.360940 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1197/2400] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:18.379536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4b43-de62-42b4-b44c-c62b6de13d82 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:18.386208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:18.389040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:18.390012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:18.392318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:18.393208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:18.394062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] PATH_INFO: `/v3/projects/e9aa74b2972a4cfab95bb9cff59175ed` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:18.396839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9aa74b2972a4cfab95bb9cff59175ed)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:18.401461 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:18.525232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9aa74b2972a4cfab95bb9cff59175ed', 'request_id': 'req-25123294-653e-4ca0-9bac-095d984bbf90'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.556739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9aa74b2972a4cfab95bb9cff59175ed', 'request_id': 'req-25123294-653e-4ca0-9bac-095d984bbf90'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.566347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9aa74b2972a4cfab95bb9cff59175ed', 'request_id': 'req-25123294-653e-4ca0-9bac-095d984bbf90'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.573990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f84392-b356-4fd7-8d82-79b4f16ed625 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:18.590194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] The token cache is being invalidate because project e9aa74b2972a4cfab95bb9cff59175ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:23:18.590756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.591709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.598168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1204/2401] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:23:18 2021] DELETE /identity/v3/projects/e9aa74b2972a4cfab95bb9cff59175ed => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:18.600815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:18.607217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:18.650688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:18.651763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:18.652247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:18.652754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:18.654999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:18.697895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123294-653e-4ca0-9bac-095d984bbf90 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:18.703900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:18.704841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:18.705119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:18.705393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] PATH_INFO: `/v3/users/fc3c42f4ac854bb68cf9b0df368e4805` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:18.706699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3c42f4ac854bb68cf9b0df368e4805)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:18.708891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:18.734051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:18.735620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:18.746588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1198/2402] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:18 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:18.784949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3c42f4ac854bb68cf9b0df368e4805'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.801935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3c42f4ac854bb68cf9b0df368e4805'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.813064 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3c42f4ac854bb68cf9b0df368e4805'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.825960 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3c42f4ac854bb68cf9b0df368e4805'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.828555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f36f09be-3baa-42df-ab9e-becae79467d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3c42f4ac854bb68cf9b0df368e4805'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:18.841880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1205/2403] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:23:18 2021] DELETE /identity/v3/users/fc3c42f4ac854bb68cf9b0df368e4805 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:19.380812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:19.397777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02cb1-3c76-454b-b914-206d88d67eac service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:19.539613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:19.541083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:19.541548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:19.542028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] PATH_INFO: `/v3/projects/c5292660e54f4fbca66726c2f86ab327` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:19.544376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5292660e54f4fbca66726c2f86ab327)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:19.548383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:19.642919 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5292660e54f4fbca66726c2f86ab327', 'request_id': 'req-489fbb99-61db-42cb-a2e4-8b6a975994d0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:19.657358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5292660e54f4fbca66726c2f86ab327', 'request_id': 'req-489fbb99-61db-42cb-a2e4-8b6a975994d0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:19.674743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5292660e54f4fbca66726c2f86ab327', 'request_id': 'req-489fbb99-61db-42cb-a2e4-8b6a975994d0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:19.705869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] The token cache is being invalidate because project c5292660e54f4fbca66726c2f86ab327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:23:19.705869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:19.705869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-489fbb99-61db-42cb-a2e4-8b6a975994d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:19.705869 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1199/2404] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:23:19 2021] DELETE /identity/v3/projects/c5292660e54f4fbca66726c2f86ab327 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:19.714600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b7e6-4f3a-443c-b97f-73ae9a063750 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:19.716046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b7e6-4f3a-443c-b97f-73ae9a063750 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:19.716415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b7e6-4f3a-443c-b97f-73ae9a063750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:19.758248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d114b7e6-4f3a-443c-b97f-73ae9a063750 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:19.759858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d114b7e6-4f3a-443c-b97f-73ae9a063750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:19.871388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1206/2405] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:19.879639 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:19.879920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:19.880193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:19.886025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:19.886433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:19.886793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:19.902580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:19.904389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:19.908302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:19.909714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:19.918724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1207/2406] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:19.925911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:19.940368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b5e33-fba1-4fe0-a66d-decf382aef45 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:19.948972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:19.950305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:19.950864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:19.951387 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:19.952779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:23:19.953271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:19.956473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:19.974046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1208/2407] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:23:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:23:19.980629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:19.985866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1200/2408] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:23:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:19.993704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f930a-7c1e-4d4d-b192-489a7147c00e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.005663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.007106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.007671 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.008235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.009847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.013884 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.065557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.068815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:20.074864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1209/2409] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:23:19 2021] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:20.082962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.172827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b56d-bd6b-44ae-8428-b0e4f3c8df93 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.235650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668670c-692e-4df7-9b5c-3401fa8e39ea admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.247123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.248296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.248853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.249316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.250655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.258986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.299092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1210/2410] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:23:20 2021] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:23:20.300512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.301140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.301427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.301813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.302163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.313245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558658-5a7e-4ed4-86b0-9f32440717c0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.319611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.320419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.320804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.321188 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.322329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.324123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.347246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1211/2411] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:20 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:20.353514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.390386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b76f-2850-45d1-a427-aa37e30d8aaf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.400382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.401334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.401837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.402313 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.403829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.407000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3a789-916b-4d60-be78-dcec073711d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.414438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.416305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.426772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1201/2412] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:23:20.429114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1212/2413] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:23:20 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:23:20.433534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.446244 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539d55-ad96-4793-8f54-cc2e8b28006b service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.451449 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.452382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.452746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.453017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] PATH_INFO: `/v3/projects/c2df09e649444bf3bb3bc80331201c25/users/ce7baeebd2974de2842369ccd0a588cb/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.460560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.461354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.462025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.472810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2df09e649444bf3bb3bc80331201c25, user_id=ce7baeebd2974de2842369ccd0a588cb, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.475607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aea61f-1d97-4c88-a977-da97053fbf1c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.497645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] MFA Rules not processed for user `525625cf3f3a4381a828f58b8ac056f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:20.499246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:20.509163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1202/2414] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:23:20 2021] PUT /identity/v3/projects/c2df09e649444bf3bb3bc80331201c25/users/ce7baeebd2974de2842369ccd0a588cb/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:20.515925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f606-add3-4dd4-8492-8c98540a9d85 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.516414 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f606-add3-4dd4-8492-8c98540a9d85 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.516927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f606-add3-4dd4-8492-8c98540a9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.551707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2220f606-add3-4dd4-8492-8c98540a9d85 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:20.553980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2220f606-add3-4dd4-8492-8c98540a9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:20.574713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1213/2415] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:20.659129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1203/2416] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:20.670859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:20.672333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:20.766244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69e9f-3c65-49b0-93e5-9cb0c99e660e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:20.772319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:20.773577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:20.774020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:20.774511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:20.802046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:20.807913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:20.839893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1214/2417] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:21.271958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d97c7-d1b9-4452-acf1-a6453806ca51 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:21.272183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d97c7-d1b9-4452-acf1-a6453806ca51 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:21.272623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d97c7-d1b9-4452-acf1-a6453806ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:21.299882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1c8d97c7-d1b9-4452-acf1-a6453806ca51 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:21.302433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1c8d97c7-d1b9-4452-acf1-a6453806ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:21.403730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1204/2418] 10.222.0.30 () {58 vars in 967 bytes} [Wed Dec 15 16:23:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:21.426178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:21.621277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04701-fc56-4087-90d1-08665fa33981 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:21.637763 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:21.638536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:21.638827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:21.639787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:21.667576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:21.669696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:21.682938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1215/2419] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:23:22.150104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17476f-7030-4779-854d-1aeb5db997f1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:22.153331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17476f-7030-4779-854d-1aeb5db997f1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:22.153331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17476f-7030-4779-854d-1aeb5db997f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:22.181113 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9d17476f-7030-4779-854d-1aeb5db997f1 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:22.183744 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d17476f-7030-4779-854d-1aeb5db997f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:22.213233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1205/2420] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:23:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:22.250637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:22.266067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a96dd-816e-494c-9072-48ea683d2e58 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:22.273630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:22.274422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:22.274743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:22.275198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:22.290777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:22.292889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:22.306324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1216/2421] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:23:22.358412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32cbb2-2ad9-4e5e-998a-8be5fa638e50 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:22.359546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32cbb2-2ad9-4e5e-998a-8be5fa638e50 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:22.362224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32cbb2-2ad9-4e5e-998a-8be5fa638e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:22.416549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8a32cbb2-2ad9-4e5e-998a-8be5fa638e50 None None] MFA Rules not processed for user `ce7baeebd2974de2842369ccd0a588cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:22.417879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a32cbb2-2ad9-4e5e-998a-8be5fa638e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:22.557828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1206/2422] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:22 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:22.571350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:22.572853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:22.709208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e707ae1-9d52-400d-aa6a-77f6c638f2ae service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:22.716522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:22.718483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:22.719231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:22.719777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:22.733151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:22.734802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:22.747212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1217/2423] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:22 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:22.934092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f2ebd-4d01-49ac-b1f6-56cb9d006631 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:22.934416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f2ebd-4d01-49ac-b1f6-56cb9d006631 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:22.934863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f2ebd-4d01-49ac-b1f6-56cb9d006631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:22.975884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-323f2ebd-4d01-49ac-b1f6-56cb9d006631 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:22.977508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-323f2ebd-4d01-49ac-b1f6-56cb9d006631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:22.991000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1207/2424] 10.222.0.30 () {58 vars in 967 bytes} [Wed Dec 15 16:23:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:23.010624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:23.043835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a95aa4-27ec-4d37-a350-d2284723139e service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:23.065219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:23.067133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:23.067601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:23.068044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:23.081448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:23.083909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:23.094209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1218/2425] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:23:24.379471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b06d-4aa3-4d53-9c26-3df8e45d8208 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:24.380573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b06d-4aa3-4d53-9c26-3df8e45d8208 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:24.380573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b06d-4aa3-4d53-9c26-3df8e45d8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:24.406179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ee88b06d-4aa3-4d53-9c26-3df8e45d8208 None None] MFA Rules not processed for user `ce7baeebd2974de2842369ccd0a588cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:24.407894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ee88b06d-4aa3-4d53-9c26-3df8e45d8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:24.429054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1208/2426] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:24 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:26.051270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:26.053649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:26.146667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305005a-0c27-4c0c-aae9-e6a351b77786 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:26.163010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:26.163010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:26.163010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:26.163010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] PATH_INFO: `/v3/users/d38e42db19b34675a217555e0982b9aa` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:26.164149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38e42db19b34675a217555e0982b9aa)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:26.167962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:26.325259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38e42db19b34675a217555e0982b9aa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:26.359149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38e42db19b34675a217555e0982b9aa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:26.382412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38e42db19b34675a217555e0982b9aa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:26.399145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38e42db19b34675a217555e0982b9aa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:26.401069 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38e42db19b34675a217555e0982b9aa'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:26.411513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1219/2427] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:23:26 2021] DELETE /identity/v3/users/d38e42db19b34675a217555e0982b9aa => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:26.418701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabb09-4377-471e-9181-b3270116efc4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:26.419579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabb09-4377-471e-9181-b3270116efc4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:26.420162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabb09-4377-471e-9181-b3270116efc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:26.564213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-87fabb09-4377-471e-9181-b3270116efc4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:26.565610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-87fabb09-4377-471e-9181-b3270116efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:26.788784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1209/2428] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:26.798476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:26.802142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:27.025994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140128ea-2e65-434e-b31d-e3a3bee78cbd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:27.041128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:27.041933 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:27.042285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:27.042628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:27.054870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:27.057207 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:27.070559 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1220/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:27.173339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:27.174785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:27.175849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:27.241157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:27.242989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:27.349531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1210/2430] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:23:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:27.380968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:27.383292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:27.491134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527fc0-3170-46b3-adb1-e3fc60fd2a9a service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:27.499615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:27.500334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:27.500654 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:27.501123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:27.514206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:27.516134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854aad-d471-4fb2-a915-bf8d0542ddae service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:27.528475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1221/2431] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:23:27.599875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:27.601884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:27.631938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85569a7-eb21-478c-955e-c307338aa9a6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:27.639654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:27.640677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:27.641294 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:27.641749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] PATH_INFO: `/v3/projects/6f1dffc761a64825a00bef3099b17c89` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:27.644146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1dffc761a64825a00bef3099b17c89)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:27.646876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:27.955158 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1dffc761a64825a00bef3099b17c89', 'request_id': 'req-ea5e0296-f2a7-4287-aec1-5f450a2952e6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:27.991837 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1dffc761a64825a00bef3099b17c89', 'request_id': 'req-ea5e0296-f2a7-4287-aec1-5f450a2952e6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:28.032645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1dffc761a64825a00bef3099b17c89', 'request_id': 'req-ea5e0296-f2a7-4287-aec1-5f450a2952e6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:28.125785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] The token cache is being invalidate because project 6f1dffc761a64825a00bef3099b17c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:23:28.129082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:28.134171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ea5e0296-f2a7-4287-aec1-5f450a2952e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:23:28.143181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1211/2432] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:23:27 2021] DELETE /identity/v3/projects/6f1dffc761a64825a00bef3099b17c89 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:23:47.912095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:47.913081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:47.913081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:47.915402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1222/2433] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:23:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:23:47.923410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd998ca2-5039-4b2e-b4fb-f92051074ae2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:47.924126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd998ca2-5039-4b2e-b4fb-f92051074ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:47.924289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd998ca2-5039-4b2e-b4fb-f92051074ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:47.979354 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cd998ca2-5039-4b2e-b4fb-f92051074ae2 None None] MFA Rules not processed for user `713e877ea43e442788f807e02578d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:47.981346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cd998ca2-5039-4b2e-b4fb-f92051074ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:48.095460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1212/2434] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:23:47 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:48.126109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:48.127920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:48.194356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db19a49-332d-4900-bbb8-e2af837db822 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:48.198751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:48.199285 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:48.199566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:48.199836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:48.212952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:48.215315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7f669-8588-4ae7-abcc-2426041bd467 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:48.232986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1223/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:48.327434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:48.327800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:48.328174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:48.330662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1213/2436] 10.222.0.30 () {54 vars in 921 bytes} [Wed Dec 15 16:23:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:23:48.337018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8a5-a9c7-4c5f-b08b-1a5d3057a7a6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:48.337320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8a5-a9c7-4c5f-b08b-1a5d3057a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:48.337564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8a5-a9c7-4c5f-b08b-1a5d3057a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:48.363743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-17c1f8a5-a9c7-4c5f-b08b-1a5d3057a7a6 None None] MFA Rules not processed for user `cc0e23d5541646cb89418f0148187fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:48.365037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-17c1f8a5-a9c7-4c5f-b08b-1a5d3057a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:48.459563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1224/2437] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Dec 15 16:23:48 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:48.475490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:48.479692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:48.524101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a8a9-ce00-428d-8476-893c777f1000 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:48.528280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:48.531213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:48.531213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:48.531213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:48.539971 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:48.541506 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa921fd-528c-4617-918c-08ad79c17fbf service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:48.553033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1214/2438] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:23:51.203204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:51.203736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:51.203736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:51.224424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] MFA Rules not processed for user `ce7baeebd2974de2842369ccd0a588cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:51.225743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:51.281271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1225/2439] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:23:51 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:23:54.018644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:54.020305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:54.020615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:54.040400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:23:54.041672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.106217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1215/2440] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:23:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:23:54.122663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:54.124617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.210312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a401c-4009-4d53-9403-c510a0914c85 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:54.216363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:54.217106 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:54.217372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:54.217647 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:54.228549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:54.230443 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:54.242314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1226/2441] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:23:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:23:54.262431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:54.266332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.506511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9490ad6-dc60-40d0-b4c0-833fd6ac5bd0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:54.525855 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:54.529140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:54.529677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:54.530023 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:54.532234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.563990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:54.570709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cde9d-e133-433c-9642-46b4e4ddf596 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:54.594271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1216/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:24:15.027741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:15.031009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:15.052806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75474-e3be-403f-8ba6-e4903c104c7f service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:15.057932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:15.062541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:15.063204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:15.063714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:15.066488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:15.164333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:15.167184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:15.186769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1227/2443] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:24:15 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:24:39.194217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403080cb-5b8c-4250-8277-ddfb2c718468 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:39.194884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403080cb-5b8c-4250-8277-ddfb2c718468 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:39.194884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403080cb-5b8c-4250-8277-ddfb2c718468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:39.264095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-403080cb-5b8c-4250-8277-ddfb2c718468 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:24:39.265380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-403080cb-5b8c-4250-8277-ddfb2c718468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:39.307799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1217/2444] 10.222.0.30 () {58 vars in 967 bytes} [Wed Dec 15 16:24:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:24:39.333066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:39.357209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d303d7-fd97-4aa6-bac1-4cfb45383b7e service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:39.363221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:39.363897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:39.364179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:39.364476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:39.374173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:39.375912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:39.385523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1228/2445] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:24:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:49.418894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa4ef-91bc-4d60-a8fd-313cf77f0614 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:49.419469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa4ef-91bc-4d60-a8fd-313cf77f0614 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:49.419469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa4ef-91bc-4d60-a8fd-313cf77f0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:49.438380 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8c4aa4ef-91bc-4d60-a8fd-313cf77f0614 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:24:49.439607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8c4aa4ef-91bc-4d60-a8fd-313cf77f0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:49.447902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1218/2446] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:24:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:24:49.461426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:49.473034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad81df-0738-47ff-a71d-d5fa664306d6 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:49.479466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:49.480186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:49.480582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:49.480871 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:49.492020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:49.493651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e278dc3-31d2-44e5-95fe-ada3acbf4185 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:49.502446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1229/2447] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:24:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:04.897739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:04.898651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:04.898651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:04.924535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] MFA Rules not processed for user `525625cf3f3a4381a828f58b8ac056f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:04.925792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:05.026157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1219/2448] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:08.543978 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:08.544684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:08.545284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:08.570639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:08.571873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:08.581210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1230/2449] 10.222.0.30 () {58 vars in 967 bytes} [Wed Dec 15 16:25:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:08.596904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:08.610247 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f686140-4514-4b31-86f4-07255cd79b17 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:08.617887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:08.619131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:08.619620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:08.620151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:08.630012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:08.631900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:08.641600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1220/2450] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:25:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:10.748694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:10.750135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:10.834006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d62789-81af-4090-a792-3e121f7909d6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:10.839340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:10.840229 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:10.840552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:10.840827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] PATH_INFO: `/v3/users/ce7baeebd2974de2842369ccd0a588cb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:10.842048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7baeebd2974de2842369ccd0a588cb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:10.844087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:10.899199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7baeebd2974de2842369ccd0a588cb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:10.913857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7baeebd2974de2842369ccd0a588cb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:10.927439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7baeebd2974de2842369ccd0a588cb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:10.943870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7baeebd2974de2842369ccd0a588cb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:10.944657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9ea3c4ce-a638-4381-997b-89cdd693a218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7baeebd2974de2842369ccd0a588cb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:10.952696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1231/2451] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:25:10 2021] DELETE /identity/v3/users/ce7baeebd2974de2842369ccd0a588cb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:25:11.509473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:11.525666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c529-6065-4556-b579-4811273c3b7f service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:11.604349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:11.605248 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:11.605532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:11.605804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] PATH_INFO: `/v3/projects/c2df09e649444bf3bb3bc80331201c25` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:11.606987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2df09e649444bf3bb3bc80331201c25)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:11.608947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:11.659712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2df09e649444bf3bb3bc80331201c25', 'request_id': 'req-139815dd-3ba1-48c3-9993-63b4736fc93c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:11.668981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2df09e649444bf3bb3bc80331201c25', 'request_id': 'req-139815dd-3ba1-48c3-9993-63b4736fc93c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:11.674646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2df09e649444bf3bb3bc80331201c25', 'request_id': 'req-139815dd-3ba1-48c3-9993-63b4736fc93c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:11.686242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] The token cache is being invalidate because project c2df09e649444bf3bb3bc80331201c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:25:11.686578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:11.687275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-139815dd-3ba1-48c3-9993-63b4736fc93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:11.689472 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1221/2452] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:25:11 2021] DELETE /identity/v3/projects/c2df09e649444bf3bb3bc80331201c25 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:25:11.695155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:11.695460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:11.695717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:11.745306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:11.746587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:11.811035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1232/2453] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:11.819314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:11.819791 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:11.820067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:11.840424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:11.841660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:11.849823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1222/2454] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:11.854585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:11.865199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0372-48f6-4604-aa82-76169d02af63 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:11.871076 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:11.871778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:11.872055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:11.872326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:11.873292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:25:11.873597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:11.875277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:11.890898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1233/2455] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:25:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:25:11.895556 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:11.907163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ad0ae-3cae-4351-ba0d-ac6ca9fd1859 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:11.917814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:11.918892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:11.919399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:11.919865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:11.921302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:11.925016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:11.951876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:11.954644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:11.969054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1223/2456] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:25:11 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:25:11.975593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:11.978910 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2421-f5f0-458b-9496-e1638675669f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.055351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2eee7-756e-4697-a936-95363548c807 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.061967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.063146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.063574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.064126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] PATH_INFO: `/v3/users/17203383b6ed406a959b7a93cf184c4d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.065153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.065786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=17203383b6ed406a959b7a93cf184c4d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.066278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.066745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.067205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.068371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.068588 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.071908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.110735 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1224/2457] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:25:11 2021] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:25:12.120501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.142115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111584d8-b27a-48b7-884c-a1e7493f19e1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.152146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.153878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.154322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.155232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.156884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.160186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.163954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17203383b6ed406a959b7a93cf184c4d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.180852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17203383b6ed406a959b7a93cf184c4d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.181805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1225/2458] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:12 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:25:12.186152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.195580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17203383b6ed406a959b7a93cf184c4d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.201452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a449ee-3a6b-4fdc-83e0-229118fc1474 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.204653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17203383b6ed406a959b7a93cf184c4d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.206020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17203383b6ed406a959b7a93cf184c4d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.206781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.207666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.208107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.208372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.209519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.211137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c719d-db02-4393-912d-032bc65ab309 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.217639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1234/2459] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:25:11 2021] DELETE /identity/v3/users/17203383b6ed406a959b7a93cf184c4d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:25:12.226384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1226/2460] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:25:12.231772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.234494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.315166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b06c-4eb5-4c97-bef7-4d2df9ffc5bc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.320354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.321310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.321604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.321876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] PATH_INFO: `/v3/projects/f522fcfc9fef4de1ba79e2f5a416ecff/users/9227cd2569074a6cbae4066c7650ea9f/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.338733 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f522fcfc9fef4de1ba79e2f5a416ecff, user_id=9227cd2569074a6cbae4066c7650ea9f, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.341659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.362686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1235/2461] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:25:12 2021] PUT /identity/v3/projects/f522fcfc9fef4de1ba79e2f5a416ecff/users/9227cd2569074a6cbae4066c7650ea9f/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:25:12.368127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.368765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.369218 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.387719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:12.388981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.440697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.442572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.466050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1227/2462] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:25:12.477267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.480056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.518718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31465da9-6e69-492d-9a29-be9c5634bd73 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.524159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.525103 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.525416 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.525792 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] PATH_INFO: `/v3/projects/4fe8b4fae71c484f939fd5379ad2ff16` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.527143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe8b4fae71c484f939fd5379ad2ff16)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.529169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.549448 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1be15-701d-4bb0-b2fb-356f25d765d0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.554809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.555480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.556060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.556060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.568036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.569847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb779d-521e-4e75-9142-a17d4aad1c8b service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.581137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1228/2463] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:12.591286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe8b4fae71c484f939fd5379ad2ff16', 'request_id': 'req-22cd9123-cffa-468c-a114-bb42ef510c8a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.597471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe8b4fae71c484f939fd5379ad2ff16', 'request_id': 'req-22cd9123-cffa-468c-a114-bb42ef510c8a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.606402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe8b4fae71c484f939fd5379ad2ff16', 'request_id': 'req-22cd9123-cffa-468c-a114-bb42ef510c8a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.625282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] The token cache is being invalidate because project 4fe8b4fae71c484f939fd5379ad2ff16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:25:12.625576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.626302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22cd9123-cffa-468c-a114-bb42ef510c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:25:12.627914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1236/2464] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:25:12 2021] DELETE /identity/v3/projects/4fe8b4fae71c484f939fd5379ad2ff16 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:25:12.636416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.636669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.636945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.657474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:12.658758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.728127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1229/2465] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:12.738789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.739184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.739468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.759633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:12.761010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:12.771099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1237/2466] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:12.777321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.791711 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ad40-9f04-499d-be19-0c49d3831c5f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.798350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.799071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.799324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.799602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.800468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:25:12.800816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.802437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.816035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1230/2467] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:25:12.821020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.831422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f7845-21bd-4ec5-8320-e94eca811622 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.837893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.838122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.838320 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.838595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.839322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.841480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.870893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1238/2468] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:25:12 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:25:12.875508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:12.886495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c139-db79-45d0-96fa-29367888833d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:12.967558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:12.968249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:12.968555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:12.968827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:12.969544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:12.971540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:12.997168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1231/2469] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:25:12 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:25:13.001406 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:13.013310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06cc24-e3de-403e-810a-62ec2c853a25 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:13.021954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:13.022650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:13.022928 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:13.023200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:13.024459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:13.026423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:13.038886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1239/2470] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:13 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:25:13.044103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:13.055788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939a4c-58f5-4114-ab55-de6496be0f5a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:13.061780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:13.062666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:13.063112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:13.063392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:13.064189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:13.065884 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40910745-5ed0-4a82-bd5d-1a02b770d5cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:13.079358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1232/2471] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:25:13.083832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:13.094886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f38d3-01c0-4925-a6cb-9bf4075752fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:13.100412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:13.102474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:13.102474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:13.102474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] PATH_INFO: `/v3/projects/370dfab4258d483f94f4dc1cbce64954/users/2a2f7c8ccd2541babbb2eb7503463cd6/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:13.120239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] RBAC: Authorizing `identity:create_grant(project_id=370dfab4258d483f94f4dc1cbce64954, user_id=2a2f7c8ccd2541babbb2eb7503463cd6, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:13.122962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:13.138083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1240/2472] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:25:13 2021] PUT /identity/v3/projects/370dfab4258d483f94f4dc1cbce64954/users/2a2f7c8ccd2541babbb2eb7503463cd6/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:25:13.143734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc356-c721-4eb5-b71b-7dd60d844c9c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:13.144095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc356-c721-4eb5-b71b-7dd60d844c9c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:13.144381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc356-c721-4eb5-b71b-7dd60d844c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:13.164781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fe2cc356-c721-4eb5-b71b-7dd60d844c9c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:13.166225 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fe2cc356-c721-4eb5-b71b-7dd60d844c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:13.232234 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1233/2473] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:25:13.243036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:13.245549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:13.324705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a47a6-8caa-4aeb-bbc9-7bb7847c574c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:13.329476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:13.330267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:13.330709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:13.331360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:13.342535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:13.344362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92b20-aefb-456b-b746-8ba45dc6aeba service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:13.364784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1241/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:14.212610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:14.213223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:14.213913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:14.247750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] MFA Rules not processed for user `2a2f7c8ccd2541babbb2eb7503463cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:14.249436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:14.344206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1234/2475] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:14 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:14.356274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eff6f-d13e-4540-b86f-082f8c4aacc6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:14.356925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eff6f-d13e-4540-b86f-082f8c4aacc6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:14.357062 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eff6f-d13e-4540-b86f-082f8c4aacc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:14.395290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f49eff6f-d13e-4540-b86f-082f8c4aacc6 None None] MFA Rules not processed for user `2a2f7c8ccd2541babbb2eb7503463cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:14.397059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f49eff6f-d13e-4540-b86f-082f8c4aacc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:14.413074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1242/2476] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:14 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:14.436282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:14.438552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:14.599342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c06f5-795d-467f-b991-f669a2df5b17 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:14.605250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:14.605927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:14.606402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:14.606534 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:14.615895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:14.617663 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:14.627361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1235/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:14 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:18.281773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.282510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.282510 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.319227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] MFA Rules not processed for user `9227cd2569074a6cbae4066c7650ea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:18.320486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:18.401150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1243/2478] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:18.405436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.406990 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:18.421589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086514-f011-4ee9-a41f-1ef167fdbbaa service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.431670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.432671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.433123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.433541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.434429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.437089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.467505 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1236/2479] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:25:18 2021] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:25:18.471259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.509695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da81c9-0162-4e06-b793-6e6df9e502f5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.599303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.600170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.600600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.600973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.601804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.604047 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.633482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1244/2480] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:25:18 2021] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:25:18.634728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.648386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b8bd-6b21-4d87-b8c3-bbee81dde316 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.654609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.656538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.656538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.656538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.656823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.658400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.674092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1237/2481] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:25:18.675463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.691703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff26a-27e8-4d28-ad8c-be13af5b9172 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.697071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.699256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.699578 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.699875 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] PATH_INFO: `/v3/projects/f422ba59fabe46a1a6d60384955044a2/users/fa3814dab79f44b8a4b6fd88af486ef3/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.719567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f422ba59fabe46a1a6d60384955044a2, user_id=fa3814dab79f44b8a4b6fd88af486ef3, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.722676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.749295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.749783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1245/2482] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:25:18 2021] PUT /identity/v3/projects/f422ba59fabe46a1a6d60384955044a2/users/fa3814dab79f44b8a4b6fd88af486ef3/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:25:18.763779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fc08-32d1-4e85-8afb-b9a9dbbe2f79 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.853235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.854318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.854774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.855427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.856398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.858281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e501494-32ce-4b28-9332-6d2d3c10f224 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.874240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1238/2483] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:25:18.876418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:18.894590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9d099-1f96-4d56-831d-ea16b0027b6b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:18.900278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:18.902160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:18.902887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:18.903351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] PATH_INFO: `/v3/projects/f422ba59fabe46a1a6d60384955044a2/users/fa3814dab79f44b8a4b6fd88af486ef3/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:18.906357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f422ba59fabe46a1a6d60384955044a2, user_id=fa3814dab79f44b8a4b6fd88af486ef3, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:18.909339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:18.924376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1246/2484] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:25:18 2021] PUT /identity/v3/projects/f422ba59fabe46a1a6d60384955044a2/users/fa3814dab79f44b8a4b6fd88af486ef3/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:25:23.926576 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b770-4cc1-4dda-baa3-63e08512ad36 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:23.927105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b770-4cc1-4dda-baa3-63e08512ad36 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:23.927105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b770-4cc1-4dda-baa3-63e08512ad36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:23.957012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cea6b770-4cc1-4dda-baa3-63e08512ad36 None None] MFA Rules not processed for user `fa3814dab79f44b8a4b6fd88af486ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:23.958474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cea6b770-4cc1-4dda-baa3-63e08512ad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:24.031627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1239/2485] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:23 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:24.045638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:24.047612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:24.143665 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b708-1003-4d49-b385-3a8f03799eae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:24.147806 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:24.148516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:24.148818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:24.149090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:24.223934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:24.225546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:24.236402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1247/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:24 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:24.365098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58001c1-233d-4703-a10f-96fd41b3fee7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:24.365389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58001c1-233d-4703-a10f-96fd41b3fee7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:24.365664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58001c1-233d-4703-a10f-96fd41b3fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:24.390795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b58001c1-233d-4703-a10f-96fd41b3fee7 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:24.392040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b58001c1-233d-4703-a10f-96fd41b3fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:24.450067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1240/2487] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:25:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:24.465219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:24.466830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:24.555163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938381dc-9784-4e73-b25d-8c30633aeeba service glance] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:24.561447 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:24.562131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:24.562401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:24.562668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:24.572724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:24.575080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dea0c8-b035-42ac-8d89-4875dfd9d99d service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:24.583557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1248/2488] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:25:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:34.832200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:34.832200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:34.832821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:34.860789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] MFA Rules not processed for user `9227cd2569074a6cbae4066c7650ea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:34.862367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:34.869852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1241/2489] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:25:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:36.887074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:36.887775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:36.887775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:36.907984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:25:36.909235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:36.917930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1249/2490] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Dec 15 16:25:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:25:36.932723 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:36.944687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941c3d9-39f2-4813-ac56-9201a297fe8b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:36.949879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:36.950440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:36.950750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:36.951330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:36.959367 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:36.960999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:36.971329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1242/2491] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:25:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:45.959204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:46.019400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4406-c6c7-440a-b96a-7a4af03ce5d0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:46.023099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:46.023761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:46.024038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:46.024306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:46.026259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:46.101585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:46.103021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:46.114949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1250/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:47.320086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:47.331035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cee967-8a3c-42e5-88ff-8613dccaa962 service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:47.335569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:47.336241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:47.336562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:47.336836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:47.338655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:47.353858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:47.355597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:47.369121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1243/2493] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:25:58.404754 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:25:58.406383 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:58.422137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27431671-6c16-45f0-ae12-f23784bb92cf service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:25:58.429140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:25:58.429796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:25:58.430082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:25:58.430362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:25:58.432248 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:25:58.497027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:25:58.498651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:25:58.508824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1251/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:25:58 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:26:57.017637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:26:57.027471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4413b-dbb3-44c1-b43d-32a62986a6fd service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:26:57.032081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:26:57.032820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:26:57.033099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:26:57.033355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:26:57.035690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:26:57.047439 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:26:57.048947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:26:57.059146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1244/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:26:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:27:11.555424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:27:11.569181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd4c3-aa68-4140-98bb-f08ccc4dab7f service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:27:11.575877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:27:11.576878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:27:11.577168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:27:11.577446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:27:11.579368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:27:11.592811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:27:11.594435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:27:11.606675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1252/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:27:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:27:32.136112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:27:32.137750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:27:32.222056 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b7ef-77cf-4679-a329-f6ce043ef179 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:27:32.226716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:27:32.227400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:27:32.227681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:27:32.227955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:27:32.230045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:27:32.293025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:27:32.294471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb416f2-de4a-487f-907d-48feaeb31c93 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:27:32.304016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1245/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:27:32 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:28:06.972867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:28:06.985071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda05b0-4fca-4f62-b7c7-95555e6650fe service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:28:06.991520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:28:06.992158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:28:06.992476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:28:06.992745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:28:06.994993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:28:07.056905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:28:07.058528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251eb9c-cee5-481b-9552-f9218dfbc206 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:28:07.068855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1253/2498] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:28:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:29:00.354257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a276-122a-43da-938d-f761845016ed None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:29:00.354946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a276-122a-43da-938d-f761845016ed None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:29:00.354946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a276-122a-43da-938d-f761845016ed None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:29:00.356774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1246/2499] 10.222.0.30 () {54 vars in 960 bytes} [Wed Dec 15 16:29:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:29:00.363374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:29:00.363997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:29:00.363997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:29:00.405523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] MFA Rules not processed for user `33525026fd94484faca1657116086daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:29:00.407355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:29:00.515449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1254/2500] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Dec 15 16:29:00 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:29:00.523587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9a276-122a-43da-938d-f761845016ed None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:29:00.539701 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9a276-122a-43da-938d-f761845016ed None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:29:00.545563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:29:00.546239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:29:00.546546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:29:00.546823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:29:00.548807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:29:00.561998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:29:00.563603 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:29:00.574865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1247/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:29:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:29:06.729423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:29:06.731414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:29:06.744381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85bb2-6af2-4aab-804a-9ae99e7f0e1c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:29:06.750944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:29:06.752066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:29:06.752518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:29:06.752966 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:29:06.756204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:29:06.820972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:29:06.822424 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:29:06.832993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1255/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:29:06 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:30:47.108004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:30:47.118793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402600d4-df1a-4c01-93cf-0d3d99fb2022 service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:30:47.123562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:30:47.123885 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:30:47.124675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:30:47.125038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:30:47.136795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:30:47.138214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:30:47.150903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1248/2503] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:30:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:30:57.782288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:30:57.796638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34d0f-2b15-4a87-b8ec-aadcd5779ece service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:30:57.804753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:30:57.805872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:30:57.806340 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:30:57.806816 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:30:57.821276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:30:57.822931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:30:57.834392 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1256/2504] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:30:57 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:31:07.178264 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:31:07.188212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bdf-f70c-4221-aff7-2e7ef61435df service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:31:07.192668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:31:07.193748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:31:07.194223 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:31:07.194687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:31:07.257871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:31:07.259364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:31:07.269348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1249/2505] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:31:07 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:31:07.313430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:31:07.323343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68298-dde3-4085-8bd2-2e96a4cc167c service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:31:07.327329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:31:07.327996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:31:07.328279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:31:07.328580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:31:07.338232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:31:07.339729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:31:07.349124 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1257/2506] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:31:07 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:31:32.754886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:31:32.771034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6805-4a9c-4c87-8a5a-58ae88ab3108 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:31:32.773365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:31:32.774021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:31:32.774305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:31:32.774575 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:31:32.785600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:31:32.787048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:31:32.798777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1250/2507] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:31:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:32:01.953371 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:32:01.963645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91efa1-4350-412b-9e3d-56ada997c311 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:32:01.968711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:32:01.969366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:32:01.969642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:32:01.969912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:32:01.978676 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:32:01.980120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511f08b-4024-45b3-9109-de8d2bbd88f2 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:32:01.989464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1258/2508] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:32:01 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:07.573417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:07.584628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1991f-9636-4c90-8702-0927a0d8ca8c service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:07.588968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:07.589626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:07.589905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:07.590170 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:07.599867 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:07.601350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:07.630520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1251/2509] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:07.981880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:07.982818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:07.983096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:08.004835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] MFA Rules not processed for user `2a2f7c8ccd2541babbb2eb7503463cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:33:08.007980 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:08.013366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1259/2510] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:33:07 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:33:08.047006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:08.056314 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee9b-0517-471b-81d7-25f6af978fe0 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:08.061876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:08.062790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:08.063149 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:08.063547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:08.074423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:08.075823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:08.105874 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1252/2511] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:08 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:33.219878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:33.261576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243271e-da24-4c1e-a48f-d5078144116d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:33.266700 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:33.267486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:33.267831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:33.268181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:33.270185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:33.306436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:33.307874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:33.316271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1260/2512] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:33.649058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:33.650585 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:33.716384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cc177-c8d7-4d6e-9de7-bdbef32c4bc2 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:33.725982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:33.727908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:33.727908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:33.727908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:33.729813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:33.742758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:33.744343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:33.755000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1253/2513] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:34.444561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:34.458760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253cb43-afd1-4162-8218-497c782685f1 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:34.465376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:34.466049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:34.466327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:34.466594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:34.468483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:34.482430 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:34.484053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:34.495668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1261/2514] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:36.489988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:36.506387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6c19-fbc0-43e1-9345-54c6dc4c1836 service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:36.513240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:36.513993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:36.514281 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:36.514546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:36.517171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:33:36.530286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:36.531928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:36.543128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1254/2515] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:33:41.536023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:33:41.548615 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0993-7ae0-426d-9e2d-1bf4237902b7 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:33:41.555444 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:33:41.556094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:33:41.556344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:33:41.556669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:33:41.566527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:33:41.568133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:33:41.578705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1262/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:33:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:34:05.027108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:34:05.049217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90183d-addf-4f32-b6ce-6de7e08a56bf service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:34:05.055559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:34:05.056202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:34:05.056476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:34:05.056788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:34:05.065864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:34:05.067548 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e11d71-cc70-4c99-8d9c-9b05e33f32b6 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:34:05.077642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1255/2517] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:34:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:34:32.884582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:34:32.897101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8de596-ec15-46d7-ae01-34ed4ee0927e service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:34:32.904741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:34:32.905380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:34:32.905651 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:34:32.905923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:34:32.914775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:34:32.916353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:34:32.944294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1263/2518] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:34:32 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:34:43.818213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:34:43.818891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:34:43.818891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:34:43.838168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] MFA Rules not processed for user `2a2f7c8ccd2541babbb2eb7503463cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:34:43.839411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:34:43.848034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1256/2519] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:34:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:35:47.341162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:35:47.342680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:35:47.401232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdd9b-e770-4daa-bfad-d712cd29bc7f service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:35:47.408094 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:35:47.408842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:35:47.409120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:35:47.409391 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:35:47.411657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:35:47.511555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:35:47.513014 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:35:47.533317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1264/2520] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:35:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:36:33.835574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:36:33.850989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce94ca-ce98-4c4f-b7c9-92ca0bd4a290 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:36:33.857896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:36:33.858739 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:36:33.859163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:36:33.859611 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:36:33.863057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:36:33.879829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:36:33.881313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:36:33.893070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1257/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:36:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:36:43.990524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:36:43.992180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:36:44.006898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda069-dd4c-4c08-9fd4-034dc6b64c4f service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:36:44.014555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:36:44.015201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:36:44.015483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:36:44.015759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:36:44.017920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:36:44.053573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:36:44.055169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:36:44.073917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1265/2522] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:36:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:37:07.942750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:37:07.952270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f3ace-0162-4a20-8ece-2e0ce3f28803 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:37:07.957099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:37:07.958179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:37:07.958459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:37:07.958725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:37:07.960896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:37:07.972013 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:37:07.973654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:37:07.982081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1258/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:37:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:37:08.614011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:37:08.623936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465a45-52a1-4108-9a5d-21bf92a85659 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:37:08.628414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:37:08.629714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:37:08.629714 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:37:08.629942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:37:08.632584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:37:08.728885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:37:08.730347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:37:08.749398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1266/2524] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:37:08 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:37:08.793320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:37:08.803027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a0d1-965b-49e3-a12b-ce0ee07df1fc service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:37:08.806742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:37:08.807395 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:37:08.807672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:37:08.807944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:37:08.809836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:37:08.889995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:37:08.891450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:37:08.911518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1259/2525] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:37:08 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:38:07.379389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:38:07.394148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7985-cfb0-4d0f-939b-8fb067e27fa5 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:38:07.401834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:38:07.402482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:38:07.402760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:38:07.403031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:38:07.405267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:38:07.449315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:38:07.451069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:38:07.468871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e1f-8f69-4ba5-a7f5-6cf8b59ae8ec service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:38:07.477369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:38:07.478027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:38:07.478309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:38:07.478579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:38:07.480747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:38:07.483731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:38:07.486120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:38:07.497955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1267/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:38:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:38:07.560966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:38:07.562552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:38:07.572183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1260/2527] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:38:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:39:12.227223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:12.228891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:12.313040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b21-0d60-42bb-bfb9-a88af383a1c8 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:12.318363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:12.318954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:12.319233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:12.319498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:12.321570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:12.334155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:12.335759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:12.346674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1268/2528] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:39:33.805902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:33.807555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:33.894710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece1ba-1710-45de-afe0-ad739b133f27 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:33.898574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:33.899330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:33.899649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:33.899959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:33.902163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:33.987151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:33.988646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:34.001666 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1261/2529] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:33 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:39:35.017125 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:35.029761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b6d5-c03c-4ac3-bdfb-c8a471e947d6 service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:35.036616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:35.037802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:35.038571 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:35.039165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:35.060122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:35.064850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415ac6-3dba-4c8a-87df-20aefc026cb3 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:35.080352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1269/2530] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:39:35.334424 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:35.345635 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3a26-097f-4196-acef-98a51dba07d4 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:35.350378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:35.351117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:35.351288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:35.351599 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:35.353649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:35.450655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:35.452210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:35.473407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1262/2531] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:39:36.415997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:36.416611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:36.416746 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:36.487222 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] MFA Rules not processed for user `8d53d9d39ed447fb8a0c725926dad501`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:36.488470 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:36.626328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1270/2532] 10.222.0.30 () {58 vars in 967 bytes} [Wed Dec 15 16:39:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:39:36.660851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:36.663306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:36.776180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3e7fc-7948-458f-b8e7-41205e36e778 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:36.782727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8dc448d7e48411eac14da58bb0fde06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:36.783392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:36.783709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:36.784293 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:36.795932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:36.797880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:36.807438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1263/2533] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Dec 15 16:39:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:39:37.221186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:37.230679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010b9ea-ee2a-4294-807a-e5a5052201a2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:37.235192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:37.236019 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:37.236585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:37.237085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:37.238997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:37.253080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:37.255084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:37.266208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1271/2534] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:39:43.679431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:43.681119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:43.697148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc528e4-26df-4eab-80e4-dc7928cb7992 service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:43.703297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:43.704204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:43.704512 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:43.704786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] PATH_INFO: `/v3/users/191079f41ac04162bcb5382c3e872f3c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:43.706277 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191079f41ac04162bcb5382c3e872f3c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:43.708267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:43.762644 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191079f41ac04162bcb5382c3e872f3c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:43.763564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191079f41ac04162bcb5382c3e872f3c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:43.771298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191079f41ac04162bcb5382c3e872f3c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:43.784819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191079f41ac04162bcb5382c3e872f3c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:43.793524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191079f41ac04162bcb5382c3e872f3c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:43.799925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1264/2535] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:39:43 2021] DELETE /identity/v3/users/191079f41ac04162bcb5382c3e872f3c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:43.984590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:43.998706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e06bc-f000-42ce-b3d5-8cb98c59dd6d service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:44.090193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:44.091473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:44.091886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:44.092411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] PATH_INFO: `/v3/projects/6f8f838e6a4647859457e5560571a5ab` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:44.093929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8f838e6a4647859457e5560571a5ab)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:44.096039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:44.197223 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8f838e6a4647859457e5560571a5ab', 'request_id': 'req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.203538 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8f838e6a4647859457e5560571a5ab', 'request_id': 'req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.210137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8f838e6a4647859457e5560571a5ab', 'request_id': 'req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.239523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] The token cache is being invalidate because project 6f8f838e6a4647859457e5560571a5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:39:44.240030 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.240879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.243166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1272/2536] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:39:43 2021] DELETE /identity/v3/projects/6f8f838e6a4647859457e5560571a5ab => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:39:44.247099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:44.249109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:44.264195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85e0-55db-40b5-90a0-55902e08d369 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:44.349338 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:44.350390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:44.351033 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:44.351369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] PATH_INFO: `/v3/users/ff6ea81405f0427282cec54854bcef12` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:44.369151 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6ea81405f0427282cec54854bcef12)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:44.371202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:44.426633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6ea81405f0427282cec54854bcef12'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.427615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6ea81405f0427282cec54854bcef12'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.435487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6ea81405f0427282cec54854bcef12'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.449629 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6ea81405f0427282cec54854bcef12'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.458820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-43e28aea-305a-482f-9198-b3b62f1f71f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6ea81405f0427282cec54854bcef12'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.468689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1265/2537] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:39:44 2021] DELETE /identity/v3/users/ff6ea81405f0427282cec54854bcef12 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:39:44.661522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:44.663159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:44.680873 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d18b8-6c25-4ad5-a0ba-b96aa22ecb97 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:44.742539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:44.743445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:44.743745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:44.743987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] PATH_INFO: `/v3/projects/bbe900a67c3c49978e14aa8b229eea8a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:44.755850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe900a67c3c49978e14aa8b229eea8a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:44.757893 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:44.808644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe900a67c3c49978e14aa8b229eea8a', 'request_id': 'req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.814560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe900a67c3c49978e14aa8b229eea8a', 'request_id': 'req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.821967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe900a67c3c49978e14aa8b229eea8a', 'request_id': 'req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.835260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] The token cache is being invalidate because project bbe900a67c3c49978e14aa8b229eea8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:39:44.835561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.836154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c4a5bc6-a9ef-47ba-a875-47b3440226ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:44.837782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1273/2538] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:39:44 2021] DELETE /identity/v3/projects/bbe900a67c3c49978e14aa8b229eea8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:44.844336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:44.844894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:44.845648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:44.910175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:44.911724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:44.981411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1266/2539] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:39:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:39:44.990138 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:44.990650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:44.990650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.009027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:45.010259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:45.019249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1274/2540] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:39:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:39:45.023985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.034437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05e29f-c51d-4761-b875-41c026d0f378 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.039081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.039760 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.040041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.040312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.041096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:39:45.041403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.043015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.065260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1267/2541] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:39:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:39:45.066398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.077196 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109210a-9812-457c-a79e-2a3f74261254 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.082440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.083092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.083376 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.083650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.084374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.086492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.134317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1275/2542] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:39:45 2021] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:39:45.139087 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.150903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716dd8a-8b3c-43fc-9f34-945a255e8e2b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.218732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.219345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.219621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.219924 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.220655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.222578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.246475 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1268/2543] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:39:45 2021] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:39:45.247759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.258924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7453-a6d2-49c3-a126-99e2c6d1f8a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.264026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.265304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.265591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.265862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.266780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.268605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.283050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1276/2544] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:39:45.287920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.302326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ceb4-12e6-4fcf-8744-f9929f02f358 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.309159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.309944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.310232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.310895 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.311785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.315004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de830d-06ed-4037-a1a7-94f6b302279e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.329400 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1269/2545] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:39:45.330711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.346762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e2cb-ed77-4f15-83dd-d8ceec15ec26 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.354762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.356316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.356804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.357593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] PATH_INFO: `/v3/projects/d40b3c22c5f248e0849252cbb305cf9e/users/b5e94ec180e040079f14eb44b7f5e6ff/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.381021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40b3c22c5f248e0849252cbb305cf9e, user_id=b5e94ec180e040079f14eb44b7f5e6ff, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.385262 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.403890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1277/2546] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:39:45 2021] PUT /identity/v3/projects/d40b3c22c5f248e0849252cbb305cf9e/users/b5e94ec180e040079f14eb44b7f5e6ff/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:45.413111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.413788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.414250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.438464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:45.440010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:45.538929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1270/2547] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:39:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:39:45.549351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.551174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:45.614419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127700cd-649b-41e7-a335-d8f27a16b969 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.619880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.620750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.621097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.621435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.644825 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.646759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.657950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1278/2548] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:39:45.776741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:45.779411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:45.793272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054ecf4-0351-402e-bc80-5bf14340cd19 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:45.800503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:45.801413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:45.801698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:45.801973 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] PATH_INFO: `/v3/users/9227cd2569074a6cbae4066c7650ea9f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:45.803212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9227cd2569074a6cbae4066c7650ea9f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:45.805802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:45.865089 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9227cd2569074a6cbae4066c7650ea9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:45.866562 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9227cd2569074a6cbae4066c7650ea9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:45.874814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9227cd2569074a6cbae4066c7650ea9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:45.889342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9227cd2569074a6cbae4066c7650ea9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:45.898320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9227cd2569074a6cbae4066c7650ea9f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:45.905705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1271/2549] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:39:45 2021] DELETE /identity/v3/users/9227cd2569074a6cbae4066c7650ea9f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:46.096303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:46.109890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cbdc9-ed94-4bda-bc53-37070ea38fcc service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:46.182568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:46.183460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:46.183735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:46.184031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] PATH_INFO: `/v3/projects/f522fcfc9fef4de1ba79e2f5a416ecff` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:46.185263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f522fcfc9fef4de1ba79e2f5a416ecff)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:46.187621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:46.234133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'request_id': 'req-31c7783d-f844-44c3-a805-4b79fa912440'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.240314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'request_id': 'req-31c7783d-f844-44c3-a805-4b79fa912440'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.246641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'request_id': 'req-31c7783d-f844-44c3-a805-4b79fa912440'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.259512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] The token cache is being invalidate because project f522fcfc9fef4de1ba79e2f5a416ecff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:39:46.259729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.260328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.261892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1279/2550] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:39:46 2021] DELETE /identity/v3/projects/f522fcfc9fef4de1ba79e2f5a416ecff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:46.265932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:46.267349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:46.281197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bd7c6-e483-4fe5-8bde-2bdeef39b1bc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:46.341423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:46.342393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:46.342727 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:46.342925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] PATH_INFO: `/v3/users/fa3814dab79f44b8a4b6fd88af486ef3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:46.361676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3814dab79f44b8a4b6fd88af486ef3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:46.364591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:46.414967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3814dab79f44b8a4b6fd88af486ef3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.415645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3814dab79f44b8a4b6fd88af486ef3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.422777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3814dab79f44b8a4b6fd88af486ef3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.434732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3814dab79f44b8a4b6fd88af486ef3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.443202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-93f5ad39-ffc5-4bce-802c-11bd89288e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3814dab79f44b8a4b6fd88af486ef3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.453818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1272/2551] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:39:46 2021] DELETE /identity/v3/users/fa3814dab79f44b8a4b6fd88af486ef3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:46.715850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:46.717945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:46.744653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7783d-f844-44c3-a805-4b79fa912440 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:46.850114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:46.851475 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:46.852093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:46.852552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] PATH_INFO: `/v3/projects/f422ba59fabe46a1a6d60384955044a2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:46.869356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f422ba59fabe46a1a6d60384955044a2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:46.871569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:46.929583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f422ba59fabe46a1a6d60384955044a2', 'request_id': 'req-151e69ec-bcae-4066-91c8-0f8606c7d83b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.937858 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f422ba59fabe46a1a6d60384955044a2', 'request_id': 'req-151e69ec-bcae-4066-91c8-0f8606c7d83b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.945900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f422ba59fabe46a1a6d60384955044a2', 'request_id': 'req-151e69ec-bcae-4066-91c8-0f8606c7d83b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.969474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] The token cache is being invalidate because project f422ba59fabe46a1a6d60384955044a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:39:46.969764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.970431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:39:46.972213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1280/2552] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:39:46 2021] DELETE /identity/v3/projects/f422ba59fabe46a1a6d60384955044a2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:50.026222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.027049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.027746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.061268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] MFA Rules not processed for user `b5e94ec180e040079f14eb44b7f5e6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:50.062563 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:50.131707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1273/2553] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:39:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:39:50.136265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.137865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:50.222352 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e69ec-bcae-4066-91c8-0f8606c7d83b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.227136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.227811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.228092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.228366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.230061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.232137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.264923 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1281/2554] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:39:50 2021] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:39:50.269057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.280698 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05e8e6-580c-4e91-9de4-b2901f5928dc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.353810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.354491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.354765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.355036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.355753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.359335 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.381902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1274/2555] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:39:50 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:39:50.385942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.398789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2c0b4-f5a6-4d2d-8d53-bd06c12bbf5e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.404728 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.405498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.405836 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.406170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.407244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.408958 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.422455 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1282/2556] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:39:50.427446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.438821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ad9e4-af4b-4231-af09-a55c24356bda admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.444153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.445114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.445394 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.445668 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] PATH_INFO: `/v3/projects/f1252bd692c845f8beef9770ebab7817/users/8b3f7206d8f14f3685b800f213906700/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.462333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1252bd692c845f8beef9770ebab7817, user_id=8b3f7206d8f14f3685b800f213906700, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.465095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.482802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1275/2557] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:39:50 2021] PUT /identity/v3/projects/f1252bd692c845f8beef9770ebab7817/users/8b3f7206d8f14f3685b800f213906700/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:39:50.486812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.497045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ca9c-4bca-4e06-869e-4d907df6214a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.563667 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.564393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.564703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.565274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.565961 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.567775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3785faf-29c9-4fbc-bd9a-8fbefbdbdaef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.581344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1283/2558] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:39:50.585752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:50.598857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ada07-29b5-44fa-9ef8-cc3cade817dd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:50.605288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:50.606208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:50.606493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:50.606753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] PATH_INFO: `/v3/projects/f1252bd692c845f8beef9770ebab7817/users/8b3f7206d8f14f3685b800f213906700/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:50.609001 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1252bd692c845f8beef9770ebab7817, user_id=8b3f7206d8f14f3685b800f213906700, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:50.611815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:50.623061 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1276/2559] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:39:50 2021] PUT /identity/v3/projects/f1252bd692c845f8beef9770ebab7817/users/8b3f7206d8f14f3685b800f213906700/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:39:55.305786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:55.306373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:55.306373 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:55.335618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] MFA Rules not processed for user `8b3f7206d8f14f3685b800f213906700`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:39:55.336778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:55.409730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1284/2560] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:39:55 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:39:55.420545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:39:55.422321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:39:55.501978 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca4c5-70f0-4f8d-98e5-ca03623e31be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:39:55.510124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:39:55.512051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:39:55.512051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:39:55.512051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:39:55.577610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:39:55.579304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:39:55.588541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1277/2561] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:39:55 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:40:48.090309 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:40:48.092318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:40:48.153413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252e63-5d4a-41e3-b6a1-9138830be9f9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:40:48.157865 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:40:48.158575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:40:48.158867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:40:48.159136 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:40:48.161439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:40:48.176365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:40:48.177841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:40:48.189725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1285/2562] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:40:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:41:03.579050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:41:03.645096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b0d1c-4ddf-455f-a96a-9bc60557d4b3 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:41:03.650034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:41:03.650906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:41:03.651186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:41:03.651460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] PATH_INFO: `/v3/users/b5e94ec180e040079f14eb44b7f5e6ff` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:41:03.652792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e94ec180e040079f14eb44b7f5e6ff)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:41:03.654759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:41:03.703363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e94ec180e040079f14eb44b7f5e6ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:03.703974 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e94ec180e040079f14eb44b7f5e6ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:03.710742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e94ec180e040079f14eb44b7f5e6ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:03.722815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e94ec180e040079f14eb44b7f5e6ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:03.730817 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e94ec180e040079f14eb44b7f5e6ff'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:03.737107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1278/2563] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:41:03 2021] DELETE /identity/v3/users/b5e94ec180e040079f14eb44b7f5e6ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:41:03.932450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:41:03.943154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e38128-07aa-4e65-9a34-10f261c054e2 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:41:04.001725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:41:04.002705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:41:04.003029 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:41:04.003485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] PATH_INFO: `/v3/projects/d40b3c22c5f248e0849252cbb305cf9e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:41:04.004706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40b3c22c5f248e0849252cbb305cf9e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:41:04.006606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:41:04.054006 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40b3c22c5f248e0849252cbb305cf9e', 'request_id': 'req-61e7e197-c90a-4bcc-be52-4d3e280bcee9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.059879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40b3c22c5f248e0849252cbb305cf9e', 'request_id': 'req-61e7e197-c90a-4bcc-be52-4d3e280bcee9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.066075 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40b3c22c5f248e0849252cbb305cf9e', 'request_id': 'req-61e7e197-c90a-4bcc-be52-4d3e280bcee9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.078981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] The token cache is being invalidate because project d40b3c22c5f248e0849252cbb305cf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:41:04.079266 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.079891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.081458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1286/2564] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:41:03 2021] DELETE /identity/v3/projects/d40b3c22c5f248e0849252cbb305cf9e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:41:04.085566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:41:04.087129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:41:04.103502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559010-0d0d-49dc-bf19-1466f7823162 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:41:04.164028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:41:04.167086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:41:04.167417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:41:04.167697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] PATH_INFO: `/v3/users/8b3f7206d8f14f3685b800f213906700` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:41:04.171410 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3f7206d8f14f3685b800f213906700)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:41:04.173539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:41:04.227126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3f7206d8f14f3685b800f213906700'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.227802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3f7206d8f14f3685b800f213906700'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.235024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3f7206d8f14f3685b800f213906700'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.247511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3f7206d8f14f3685b800f213906700'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.256143 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3f7206d8f14f3685b800f213906700'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.262691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1279/2565] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:41:04 2021] DELETE /identity/v3/users/8b3f7206d8f14f3685b800f213906700 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:41:04.442724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:41:04.444270 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:41:04.458529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e197-c90a-4bcc-be52-4d3e280bcee9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:41:04.523760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:41:04.524630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:41:04.524917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:41:04.525194 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] PATH_INFO: `/v3/projects/f1252bd692c845f8beef9770ebab7817` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:41:04.526451 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1252bd692c845f8beef9770ebab7817)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:41:04.528699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:41:04.584721 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1252bd692c845f8beef9770ebab7817', 'request_id': 'req-b0020217-ef4e-47d3-b763-d0777b36fd81'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.592251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1252bd692c845f8beef9770ebab7817', 'request_id': 'req-b0020217-ef4e-47d3-b763-d0777b36fd81'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.598405 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1252bd692c845f8beef9770ebab7817', 'request_id': 'req-b0020217-ef4e-47d3-b763-d0777b36fd81'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.611575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] The token cache is being invalidate because project f1252bd692c845f8beef9770ebab7817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:41:04.611818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.612476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:41:04.614107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1287/2566] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:41:04 2021] DELETE /identity/v3/projects/f1252bd692c845f8beef9770ebab7817 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:41:34.106490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:41:34.108138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:41:34.173046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdeca-46a4-4f3a-81af-d85cab52d95d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:41:34.225050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:41:34.225911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:41:34.226193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:41:34.228108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:41:34.230224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:41:34.310420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:41:34.311932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:41:34.323381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1280/2567] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:41:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:42:08.905211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:42:08.906891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:42:08.923844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0020217-ef4e-47d3-b763-d0777b36fd81 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:42:08.929584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:42:08.930342 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:42:08.930624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:42:08.930912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:42:08.932842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:42:08.993914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:42:08.995527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:42:09.005568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1288/2568] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:42:08 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:42:12.926871 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:42:12.928559 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:42:12.943555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977b26-5594-4f2b-b9d9-9f859b8adf26 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:42:12.950340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:42:12.951243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:42:12.951564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:42:12.951859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:42:12.954674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:42:12.965136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:42:12.966964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:42:12.975456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1281/2569] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:42:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:43:10.445146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:10.447372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:10.510657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554c67-2f9f-49d9-b284-a9ca97347518 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:10.515528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:10.516189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:10.516467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:10.516775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:10.519002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:10.577767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:10.579200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:10.588239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1289/2570] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:10 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:43:10.631906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:10.641156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e2e7-aea3-4228-ac74-bdf9e85e18e4 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:10.645128 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:10.645769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:10.646044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:10.646315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:10.648094 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:10.717452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:10.718965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:10.744661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1282/2571] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:43:10.861835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:10.870883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7388-341a-49c9-ac2d-3bb7c8e9ad06 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:10.875020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:10.875658 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:10.875938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:10.876209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:10.878122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:10.889333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] Could not find project: 6f8f838e6a4647859457e5560571a5ab.: keystone.exception.ProjectNotFound: Could not find project: 6f8f838e6a4647859457e5560571a5ab. Dec 15 16:43:10.890629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1290/2572] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:10 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 15 16:43:13.283238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:13.284951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:13.298261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3c02-d3e5-4702-9f73-9a1d69dd0765 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:13.302831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:13.303471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:13.303750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:13.304015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:13.306160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:13.369647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:13.371075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:13.386066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1283/2573] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:43:13.941413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:13.942877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:13.959730 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351aa70-5239-401e-89e8-c00505205802 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:13.966401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:13.969138 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:13.969420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:13.969687 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] PATH_INFO: `/v3/users/2a2f7c8ccd2541babbb2eb7503463cd6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:13.971012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2f7c8ccd2541babbb2eb7503463cd6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:13.972979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.033404 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2f7c8ccd2541babbb2eb7503463cd6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.045907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2f7c8ccd2541babbb2eb7503463cd6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.054498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2f7c8ccd2541babbb2eb7503463cd6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.062096 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2f7c8ccd2541babbb2eb7503463cd6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.062732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d389f5a-bae7-4975-88f0-3f173b8d30bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2f7c8ccd2541babbb2eb7503463cd6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.068584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1291/2574] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:43:13 2021] DELETE /identity/v3/users/2a2f7c8ccd2541babbb2eb7503463cd6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:43:14.241208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.252161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cde52-ab63-4dd7-bb64-4e9b03fab3ce service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.309115 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.309905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.310181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.310451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] PATH_INFO: `/v3/projects/370dfab4258d483f94f4dc1cbce64954` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.311669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370dfab4258d483f94f4dc1cbce64954)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.313648 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.361604 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370dfab4258d483f94f4dc1cbce64954', 'request_id': 'req-b481f1dd-824c-4fa0-a86a-c2b376b554b8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.369249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370dfab4258d483f94f4dc1cbce64954', 'request_id': 'req-b481f1dd-824c-4fa0-a86a-c2b376b554b8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.374613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370dfab4258d483f94f4dc1cbce64954', 'request_id': 'req-b481f1dd-824c-4fa0-a86a-c2b376b554b8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.385187 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] The token cache is being invalidate because project 370dfab4258d483f94f4dc1cbce64954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:43:14.385474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.386086 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b481f1dd-824c-4fa0-a86a-c2b376b554b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:43:14.387613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1284/2575] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:43:14 2021] DELETE /identity/v3/projects/370dfab4258d483f94f4dc1cbce64954 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:43:14.394549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.394831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.395101 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.415000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:43:14.416201 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:14.490333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1292/2576] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:43:14.502069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.502385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.502655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.521677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:43:14.522879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:14.532103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1285/2577] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:43:14.536915 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.552606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ecb0-43ce-489d-b481-b389a5d70082 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.561040 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.561969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.562247 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.562516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.563264 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:43:14.563563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.565258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.577460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1293/2578] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:43:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:43:14.583865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.594738 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48862-d79a-4c9f-85e0-a6b984ba65da None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.599893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.600558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.600859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.601127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.601859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.603761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.632253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1286/2579] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:43:14.636630 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.647189 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3f8d9-d042-47c0-aed8-681d11529d71 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.711333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.712211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.712529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.712794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.713787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.717134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.741300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1294/2580] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/users => generated 278 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:43:14.746046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.756842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190001-3724-4906-9e41-4144111ac0e5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.762022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.762904 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.763210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.763493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.764263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.766216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.778064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1287/2581] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:43:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:43:14.782298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.792515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d286b1-17fa-4697-8f21-c001ce70fb68 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.797882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.798556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.798841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.799119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.799993 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.801663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4507b8-e820-443b-805a-b49312a3264a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.815491 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1295/2582] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:43:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:43:14.816670 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:14.826708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa923d-48de-49f5-b2a9-0bb458fd6cd1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:14.832938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:14.833839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.834119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.834389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] PATH_INFO: `/v3/projects/60202ca2ab5d414885689cab973262f2/users/07646899013d49b1a741554408f5297c/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.850205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60202ca2ab5d414885689cab973262f2, user_id=07646899013d49b1a741554408f5297c, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:14.852907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:14.867694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1288/2583] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:43:14 2021] PUT /identity/v3/projects/60202ca2ab5d414885689cab973262f2/users/07646899013d49b1a741554408f5297c/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:43:14.879012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:14.879302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:14.879580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:14.907059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] MFA Rules not processed for user `07646899013d49b1a741554408f5297c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:43:14.908366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:14.974253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1296/2584] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:43:14.978893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.043620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3430d2-6755-435f-a1dd-9d8fab8fe382 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.049074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.049746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.050002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.050311 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.050997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.052936 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.080965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1289/2585] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:43:14 2021] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:43:15.085048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.096097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477693-c648-4508-935e-d9eb74d7ea4a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.162398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.163074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.163354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.163625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.164326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.166323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.193297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1297/2586] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:43:15 2021] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:43:15.197420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.208497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a336d3-d59e-4c9c-ba9b-fcd775a2e40f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.214315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.214982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.215259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.215528 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.216262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.218267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.230830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1290/2587] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:43:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:43:15.235243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.245516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0846c-8345-444e-9000-58cdb0274256 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.250972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.251862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.252143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.252448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] PATH_INFO: `/v3/projects/d047307aecd24d9381192df2c8b1a605/users/ca4147e40e0a478583c326411b9b8fd5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.268312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d047307aecd24d9381192df2c8b1a605, user_id=ca4147e40e0a478583c326411b9b8fd5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.271032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.285844 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1298/2588] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:43:15 2021] PUT /identity/v3/projects/d047307aecd24d9381192df2c8b1a605/users/ca4147e40e0a478583c326411b9b8fd5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:43:15.289964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.300167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972835dd-821e-431e-bf28-4d1283670172 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.363840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.364560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.364913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.365249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.366355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.368831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ece797-d5da-4ec4-9ce4-c66d2b033323 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.380638 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1291/2589] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:43:15 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:43:15.384967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.395412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb6c4-407a-4cfd-b1b2-4231cd2862f6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.400134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.401067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.401348 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.401626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] PATH_INFO: `/v3/projects/d047307aecd24d9381192df2c8b1a605/users/ca4147e40e0a478583c326411b9b8fd5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.403648 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d047307aecd24d9381192df2c8b1a605, user_id=ca4147e40e0a478583c326411b9b8fd5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.406627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.419068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1299/2590] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:43:15 2021] PUT /identity/v3/projects/d047307aecd24d9381192df2c8b1a605/users/ca4147e40e0a478583c326411b9b8fd5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:43:15.429802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.430165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.430443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.457140 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] MFA Rules not processed for user `ca4147e40e0a478583c326411b9b8fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:43:15.458349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:15.526398 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1292/2591] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:43:15 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:43:15.536965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.538855 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:43:15.597514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d35d4-49ec-4819-851a-bf00df47c17d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.601478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.602186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.602369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.602662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.612332 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.613788 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.623050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1300/2592] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:15 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:43:15.697600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:43:15.711620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57ed4d-3ae6-4ec9-b186-0e151311ef11 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:43:15.717676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:43:15.718397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:43:15.718689 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:43:15.719108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:43:15.787520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:43:15.789005 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:43:15.798219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1293/2593] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:43:15 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:44:21.187060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:44:21.189351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:44:21.328321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6412c-7276-414a-aee3-b246790210ef service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:44:21.333818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:44:21.334471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:44:21.334749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:44:21.335018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:44:21.336996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:44:21.349986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:44:21.351590 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:44:21.361777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1301/2594] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:44:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:44:33.949406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:44:33.950951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:44:34.050137 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7d68-179c-409f-91a0-e295b1b713f3 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:44:34.056122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:44:34.056812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:44:34.057178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:44:34.057372 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:44:34.059168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:44:34.131582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:44:34.133213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:44:34.150614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1294/2595] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:44:33 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:10.133679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:10.162482 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54561d92-1f63-44b2-be63-fd4d7a743a49 service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:10.170109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:10.170930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:10.171245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:10.171779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:10.173486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:10.192181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:10.192469 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dd98c-1d60-41f2-8c2c-b288109516dc service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:10.210252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1302/2596] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:11.805813 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:11.807265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:11.838004 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55765-1ff4-4f9e-a2b6-c85dd230e374 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:11.847736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:11.849664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:11.850251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:11.850717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:11.853312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:11.870816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:11.872503 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:11.885646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1295/2597] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:12.496413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:12.496985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:12.497107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:12.524258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] MFA Rules not processed for user `b7f047bf1080497290a18bff8b4e4337`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:45:12.525564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:12.580633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1303/2598] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:45:12 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:45:12.949456 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:12.950954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:13.026778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32a0bb-a5a5-49fb-b174-8e21584a1243 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:13.030418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:13.031067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:13.031358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:13.031633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:13.033612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:13.043812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:13.045280 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:13.053777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1296/2599] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:13.379139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:13.380839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:13.396656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520c0d-ab74-4fe2-89a9-428aaea3dccd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:13.402904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:13.403743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:13.404185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:13.404698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:13.406527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:13.421708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:13.423401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:13.434191 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1304/2600] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:22.694488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:22.709252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67eabb-fa79-407f-ab77-2ee52cfc3c50 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:22.714886 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:22.715529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:22.715807 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:22.716078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:22.717963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:22.730839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:22.732721 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:22.743714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1297/2601] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:45:48.505971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:45:48.520835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e7c9-15ec-4dd8-b550-2414a92d83f3 service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:45:48.525460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:45:48.526160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:45:48.526435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:45:48.526724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:45:48.528889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:45:48.561738 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:45:48.563174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:45:48.583034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1305/2602] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:45:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:46:34.365276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:46:34.375520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74229f87-7724-42ce-8e70-f185e52ca701 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:46:34.379533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:46:34.380272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:46:34.380557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:46:34.380877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:46:34.382751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:46:34.398477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:46:34.399955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:46:34.412254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1298/2603] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:46:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:47:08.744013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:47:08.755362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acdae8-f75a-47e0-a18d-960537e39ee3 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:47:08.761799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:47:08.762452 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:47:08.762723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:47:08.762991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:47:08.765172 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:47:08.776168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:47:08.777809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:47:08.787445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1306/2604] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:47:08 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:48:10.644784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:48:10.656860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b810d-2778-4586-84f7-783664635eeb service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:48:10.663134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:48:10.663771 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:48:10.664050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:48:10.664326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:48:10.666509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:48:10.736096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:48:10.737793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:48:10.747369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1299/2605] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:49:29.178493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:49:29.190089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2a41-fdb1-4f71-855d-cf60b8a36fd0 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:49:29.195906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:49:29.196577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:49:29.196868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:49:29.197137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:49:29.207541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:49:29.209911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:49:29.225235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1307/2606] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:49:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:49:35.232331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:49:35.233866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:49:35.266893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2124a-9b5e-4642-9870-602b17571615 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:49:35.270510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:49:35.271161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:49:35.271438 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:49:35.271707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:49:35.280222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:49:35.281811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:49:35.292214 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1300/2607] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:49:35.360850 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:49:35.369996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1cd2-6ac9-4280-93df-474bf692808c service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:49:35.373415 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:49:35.374042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:49:35.374401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:49:35.374677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:49:35.383123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:49:35.384586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ce9d-483b-4873-8bee-60b7c0257d04 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:49:35.393314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1308/2608] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:50:50.285598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:50:50.297545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a89a2-eacb-4210-aea2-66a7f42b1ab5 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:50:50.303923 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:50:50.304601 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:50:50.304880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:50:50.305155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:50:50.316827 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:50:50.318300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:50:50.329594 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1301/2609] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:50:50 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:51:11.619768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:11.620385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:11.620385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:11.647465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] MFA Rules not processed for user `5686da93293e439eaf999b67fc154b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:51:11.648704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:51:11.655705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1309/2610] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:51:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:51:11.997108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:51:12.006442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd2d2-8f0c-4e3d-a3b8-f6e06332ea8d service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:51:12.011190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:51:12.011841 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:12.012110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:12.012390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:12.020587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:51:12.022031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:51:12.029983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1302/2611] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:51:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:51:14.412597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:51:14.425294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a1d9-009d-4162-b9c5-378aad40129b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:51:14.431631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:51:14.432268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:14.432576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:14.432845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:14.441965 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:51:14.443546 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:51:14.453932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1310/2612] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:51:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:51:17.134075 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:51:17.143573 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508b41-12af-4117-96f0-52899b6d5fc3 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:51:17.147260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:51:17.147966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:17.148262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:17.148568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:17.150520 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:51:17.161082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:51:17.162583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:51:17.171423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1303/2613] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:51:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:51:17.776236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:51:17.792550 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d505-e163-4ce8-a104-b320f47a535f service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:51:17.803414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:51:17.804090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:17.804368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:17.805499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:17.816693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:51:17.818227 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:51:17.830888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1311/2614] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:51:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:51:24.404070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:51:24.417951 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd7ec-fe40-4f8f-a5ef-60c6e198119c service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:51:24.423694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:51:24.424349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:51:24.424675 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:51:24.424949 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:51:24.434605 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:51:24.436302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:51:24.447224 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1304/2615] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:51:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:53:06.614071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:53:06.624669 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf07d-08fe-479c-99f6-1ea6dfba0acd service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:53:06.629542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:53:06.630204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:53:06.630466 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:53:06.630735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:53:06.642013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:53:06.643440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:53:06.654991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1312/2616] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:53:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:53:12.356742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:53:12.372704 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51478d0-894b-45ef-94db-f11ee0f6ee39 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:53:12.378212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:53:12.378793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:53:12.379072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:53:12.379341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:53:12.388589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:53:12.390500 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:53:12.420020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1305/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:53:12 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:53:36.122161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:53:36.173680 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0b76-1693-4ef9-a8b2-089b8624a5cd service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:53:36.177374 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:53:36.178026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:53:36.178303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:53:36.178573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:53:36.187544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:53:36.189018 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:53:36.216584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1313/2618] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:53:36 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:54:34.153725 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:54:34.155343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:54:34.306306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330d3b-52bb-4d1e-911d-a56fef6ff7b0 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:54:34.315054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:54:34.315710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:54:34.315987 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:54:34.316253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:54:34.318434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:54:34.330550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:54:34.332152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:54:34.342586 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1306/2619] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:54:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:55:12.513000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:55:12.515600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:55:12.540353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b32f5-6ba5-4e2c-b7f5-a1818f8e7dac service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:55:12.545041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:55:12.545686 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:55:12.545931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:55:12.546197 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:55:12.548243 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:55:12.638526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:55:12.639952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:55:12.659105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1314/2620] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:55:12 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:55:12.746509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:55:12.756018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b888-e70a-4bdf-ae64-8242e7e96138 service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:55:12.760452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:55:12.761172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:55:12.761458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:55:12.761728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:55:12.763832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:55:12.845307 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:55:12.846748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:55:12.865250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1307/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:55:12 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:29.672803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:29.674636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:29.785906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30aa00-15e8-440e-8c33-78a849459bd3 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:29.792174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:29.792886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:29.793166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:29.793449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:29.795610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:29.819437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] Could not find project: d40b3c22c5f248e0849252cbb305cf9e.: keystone.exception.ProjectNotFound: Could not find project: d40b3c22c5f248e0849252cbb305cf9e. Dec 15 16:56:29.821143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1315/2622] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:29 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 15 16:56:30.312416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:30.314042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:30.404517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d227d6e-29ea-4f61-9fa2-f70f3d340b14 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:30.408880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:30.409521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:30.409801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:30.410093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:30.417853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:30.419284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:30.427320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1308/2623] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:31.115123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:31.129807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100514-7826-494e-b32a-b1bda87603e3 service glance] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:31.134990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:31.135717 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:31.136212 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:31.136581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:31.139362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:31.239706 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:31.241265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:31.266579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1316/2624] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:31.632693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:31.635434 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:31.757139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c979-0a6e-4d96-b78a-a017e3cf2280 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:31.764845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:31.765508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:31.765792 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:31.766069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:31.768021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:31.782227 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:31.783848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:31.794708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1309/2625] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:32.374277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:32.384287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77ff4-d092-4f23-be5c-f99419f5aa18 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:32.389732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:32.390418 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:32.390695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:32.390972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:32.393250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:32.488493 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:32.490046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:32.512605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1317/2626] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:32 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:34.590112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:34.594022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:34.607852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d7245-1124-4e66-9972-2a4b06b21e38 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:34.616464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:34.616464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:34.616464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:34.616464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] PATH_INFO: `/v3/users/b7f047bf1080497290a18bff8b4e4337` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:34.629260 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f047bf1080497290a18bff8b4e4337)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:34.631436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:34.688200 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f047bf1080497290a18bff8b4e4337'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:34.688918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f047bf1080497290a18bff8b4e4337'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:34.696634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f047bf1080497290a18bff8b4e4337'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:34.710545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f047bf1080497290a18bff8b4e4337'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:34.726736 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2c8dc621-c6aa-4d7d-bb33-9ad5e4866a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f047bf1080497290a18bff8b4e4337'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:34.736211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1310/2627] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:34 2021] DELETE /identity/v3/users/b7f047bf1080497290a18bff8b4e4337 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:34.911527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:34.924996 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc6087-1e9d-4b17-9a71-99e74227c2c2 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:34.985432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:34.986290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:34.986568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:34.986835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] PATH_INFO: `/v3/projects/4bb083b5a25444b3845b0f49b8b6f4d6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:34.988020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb083b5a25444b3845b0f49b8b6f4d6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:34.990145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.038120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb083b5a25444b3845b0f49b8b6f4d6', 'request_id': 'req-1619ec02-3261-43c7-87be-f8368fcd52e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:35.043828 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb083b5a25444b3845b0f49b8b6f4d6', 'request_id': 'req-1619ec02-3261-43c7-87be-f8368fcd52e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:35.050134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb083b5a25444b3845b0f49b8b6f4d6', 'request_id': 'req-1619ec02-3261-43c7-87be-f8368fcd52e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:35.064953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] The token cache is being invalidate because project 4bb083b5a25444b3845b0f49b8b6f4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:35.065233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:35.065927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1619ec02-3261-43c7-87be-f8368fcd52e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:35.067536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1318/2628] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:34 2021] DELETE /identity/v3/projects/4bb083b5a25444b3845b0f49b8b6f4d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:35.074669 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.074950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.075217 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.143288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:35.145008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.209564 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1311/2629] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:35.219249 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.219612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.220043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.240743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:35.242056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.251710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1319/2630] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:35.256098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.266262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c21d2e-105d-44e0-8678-59d327307226 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.271076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.271734 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.272014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.272290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.273070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:35.273368 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.274945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.288141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1312/2631] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:56:35.292169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.301400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dc5ff-824d-4a30-8454-da4c54a2006b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.306077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.306729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.307005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.307345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.308366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.310289 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.351310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1320/2632] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:35 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:35.355888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.366977 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6fdb-3c88-4948-988f-a63a57a8420d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.423350 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.424031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.424310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.424615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.425319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.427569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.448251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1313/2633] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:35 2021] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:35.452438 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.463693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba70-d384-4ed3-b4d6-b40882174e4b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.470206 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.470945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.471231 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.471505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.472465 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.474088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.488235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1321/2634] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:56:35.489681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.500196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f47b-5d03-4a4d-9b09-05a260806712 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.505511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.506364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.506652 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.506954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.507851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.509602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.522852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1314/2635] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:56:35.527597 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.540813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e800ee-7075-4d13-ae31-5abd319911c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.548060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.549037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.549224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.549496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] PATH_INFO: `/v3/projects/34bf934a6472483197d84a82101192c6/users/b16f85c8ccb34f50b155c52bb892cb39/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.568972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bf934a6472483197d84a82101192c6, user_id=b16f85c8ccb34f50b155c52bb892cb39, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.571270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.572027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c89c-e12f-4cb5-ae24-ebe985b58274 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.573728 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.599042 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1322/2636] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:35 2021] PUT /identity/v3/projects/34bf934a6472483197d84a82101192c6/users/b16f85c8ccb34f50b155c52bb892cb39/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:35.611010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.611303 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.611582 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.640061 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] MFA Rules not processed for user `b16f85c8ccb34f50b155c52bb892cb39`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:35.641295 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.647175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2d5e-6213-4b21-b44d-da00008cbad9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.695102 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.695660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.695941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.696210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.698155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.705581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1323/2637] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:35 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:35.717760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.719108 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.758549 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.759991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.769654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1315/2638] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:35.790679 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4d28b-c54a-4338-867a-b0b77914d8c8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:35.797811 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713e877ea43e442788f807e02578d0d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:35.798664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:35.798950 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:35.799230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:35.807791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:35.809587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:35.819359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1324/2639] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:35.937083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:35.938561 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:35.998404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec63556-4981-4e0e-b337-4aab35004838 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.001965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.002649 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.002923 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.003216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.005110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.018955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.020461 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7358dca-207a-401e-b26a-12602d4371fd service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.031630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1316/2640] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:36.101555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:36.113554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0a25-4ff5-478d-ac39-d02a31d1bc97 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.119218 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.120120 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.120380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.120688 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] PATH_INFO: `/v3/users/b16f85c8ccb34f50b155c52bb892cb39` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.122053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16f85c8ccb34f50b155c52bb892cb39)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.124065 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.172876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16f85c8ccb34f50b155c52bb892cb39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.184462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16f85c8ccb34f50b155c52bb892cb39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.193446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16f85c8ccb34f50b155c52bb892cb39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.202674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16f85c8ccb34f50b155c52bb892cb39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.203365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16f85c8ccb34f50b155c52bb892cb39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.209623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1325/2641] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:36 2021] DELETE /identity/v3/users/b16f85c8ccb34f50b155c52bb892cb39 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:36.216366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.216688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.217129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.235256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:36.236788 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.281026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:36.282488 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.300938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1317/2642] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:36.310953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:36.312488 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.349253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dec40-d71f-4faf-8e19-86f7b45e389e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.353846 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.355070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.355353 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.355627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] PATH_INFO: `/v3/users/525625cf3f3a4381a828f58b8ac056f3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.356956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525625cf3f3a4381a828f58b8ac056f3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.358912 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.368174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf2be4-57b0-47d5-a860-b9dab41d483a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.372100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.372768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.373044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.373313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.383267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.385444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.396718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1318/2643] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:36.408963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525625cf3f3a4381a828f58b8ac056f3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.421744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525625cf3f3a4381a828f58b8ac056f3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.433474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525625cf3f3a4381a828f58b8ac056f3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.440378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525625cf3f3a4381a828f58b8ac056f3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.441055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525625cf3f3a4381a828f58b8ac056f3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.446756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1326/2644] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:36 2021] DELETE /identity/v3/users/525625cf3f3a4381a828f58b8ac056f3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:36.626963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:36.637384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e32b7-7bf9-4802-9b21-a2d99a187abc service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.678967 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:36.680613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.727044 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.727918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.728193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.728492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] PATH_INFO: `/v3/projects/2ce9eb0396d945e692eb72ae3f344a66` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.737427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce9eb0396d945e692eb72ae3f344a66)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.739676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.765049 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5e03d-a414-4ace-a437-22b252fe7834 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:36.770640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:36.771565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.771863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.772160 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] PATH_INFO: `/v3/projects/34bf934a6472483197d84a82101192c6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.773460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bf934a6472483197d84a82101192c6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:36.775519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:36.793110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce9eb0396d945e692eb72ae3f344a66', 'request_id': 'req-041ddd63-f322-4997-9730-2e7f4b998ada'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.801887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce9eb0396d945e692eb72ae3f344a66', 'request_id': 'req-041ddd63-f322-4997-9730-2e7f4b998ada'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.808829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce9eb0396d945e692eb72ae3f344a66', 'request_id': 'req-041ddd63-f322-4997-9730-2e7f4b998ada'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.820492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] The token cache is being invalidate because project 2ce9eb0396d945e692eb72ae3f344a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:36.820787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.821551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-041ddd63-f322-4997-9730-2e7f4b998ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.825529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1319/2645] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:36 2021] DELETE /identity/v3/projects/2ce9eb0396d945e692eb72ae3f344a66 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:36.852277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bf934a6472483197d84a82101192c6', 'request_id': 'req-301978ff-e443-416d-a3d2-00ff1c46c61c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.858886 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bf934a6472483197d84a82101192c6', 'request_id': 'req-301978ff-e443-416d-a3d2-00ff1c46c61c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.869224 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bf934a6472483197d84a82101192c6', 'request_id': 'req-301978ff-e443-416d-a3d2-00ff1c46c61c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.888922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] The token cache is being invalidate because project 34bf934a6472483197d84a82101192c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:36.889520 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.890786 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-301978ff-e443-416d-a3d2-00ff1c46c61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:36.893008 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1327/2646] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:36 2021] DELETE /identity/v3/projects/34bf934a6472483197d84a82101192c6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:36.900418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:36.900418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:36.900418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:36.920295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:36.922322 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:36.995918 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1320/2647] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:37.004013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.004818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.005263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.025241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:37.026472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:37.034334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1328/2648] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:37.038712 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.048388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abaa49-8c53-4889-a37d-cc959d855271 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.053147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.054035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.054513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.054995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.055942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:37.056497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.058412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.070801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1321/2649] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:56:37.077339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.084777 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad92c99-63c6-480f-a09e-01af3f4e3de2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.090084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.090749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.091025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.091297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.092031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.093956 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.120719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1329/2650] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:56:37.124984 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.140784 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfe5e-298e-44f7-9ca0-40b4e26e1064 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.212802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.213694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.213972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.214245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.214929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.216878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.239176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1322/2651] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:56:37.243413 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.255083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dacc-dbb2-43f4-be1a-027e5433928e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.260296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.261005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.261276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.261616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.262433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.264118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.275440 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1330/2652] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:56:37.279915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.290313 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0e2b-af07-4057-8f21-7a4155e7a16c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.295570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.296251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.296558 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.296934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.297633 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.299123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6be712-25b0-4191-a307-337ab0c8134d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.309508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1323/2653] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:37.313882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.324767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a8fc-de47-4e90-95af-f3af9af9c9ae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.332501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.333976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.334300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.334675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] PATH_INFO: `/v3/projects/86a7d14fff9641ceacb624eb59f6ef5a/users/9976b8bd89ce495ebe0cc19354e3c076/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.351473 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a7d14fff9641ceacb624eb59f6ef5a, user_id=9976b8bd89ce495ebe0cc19354e3c076, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.354199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.370984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1331/2654] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:37 2021] PUT /identity/v3/projects/86a7d14fff9641ceacb624eb59f6ef5a/users/9976b8bd89ce495ebe0cc19354e3c076/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:37.386876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.387199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.387481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.415565 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] MFA Rules not processed for user `9976b8bd89ce495ebe0cc19354e3c076`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:37.416969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:37.499377 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1324/2655] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:37.504761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.576456 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d5f9-c712-4767-a272-c4cc3b14618d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.582023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.582685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.582974 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.583256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.583964 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.585918 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.618971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1332/2656] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:37.625290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.639980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7addb5-2937-48b5-b8d5-92ab2f51e3ff None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.700097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.700804 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.701071 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.701358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.702052 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.703980 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.726365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1325/2657] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:37.731380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.742318 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22c862-95c9-414b-91ef-03e93aaaed22 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.748043 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.748760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.749037 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.749304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.750071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.751725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.762781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1333/2658] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:37.767203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.777674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b797-47ba-49f3-9da8-37546e7cb829 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.782677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.783571 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.783829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.784093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] PATH_INFO: `/v3/projects/a87e9bc7612140159a4ebd80e70dcd64/users/709e18cc2ae54997871bb03aa1d5476d/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.801979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87e9bc7612140159a4ebd80e70dcd64, user_id=709e18cc2ae54997871bb03aa1d5476d, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.804998 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.820863 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1326/2659] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:37 2021] PUT /identity/v3/projects/a87e9bc7612140159a4ebd80e70dcd64/users/709e18cc2ae54997871bb03aa1d5476d/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:37.824683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.834583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dc7c0-06f0-4137-953b-0cd8aef1ec0d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.892258 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.892979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.893454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.893570 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.894347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.895849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99d7f0-6848-45a2-885e-95174ccf9986 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.907099 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1334/2660] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:37 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:37.911436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:37.922555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7cbef-7478-4ed0-b06d-83316cc37396 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:37.928320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:37.929258 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.929535 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.929805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] PATH_INFO: `/v3/projects/a87e9bc7612140159a4ebd80e70dcd64/users/709e18cc2ae54997871bb03aa1d5476d/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.931844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87e9bc7612140159a4ebd80e70dcd64, user_id=709e18cc2ae54997871bb03aa1d5476d, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:37.934780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:37.945100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1327/2661] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:37 2021] PUT /identity/v3/projects/a87e9bc7612140159a4ebd80e70dcd64/users/709e18cc2ae54997871bb03aa1d5476d/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:37.957650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:37.958105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:37.958513 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:37.989877 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] MFA Rules not processed for user `709e18cc2ae54997871bb03aa1d5476d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:37.991116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:38.059090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1335/2662] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:37 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:38.070029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:38.071805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:38.131305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d362-c736-4402-8701-34ceb5aad5bd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:38.138749 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:38.139685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:38.139961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:38.140231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:38.150069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:38.151612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6f743-1c00-47aa-b43e-d094de38f95d service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:38.161870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1328/2663] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:38 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:38.435725 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:38.510279 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d3b0d-ba3a-43a5-a5ad-1102d32772e6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:38.515274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:38.516175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:38.516464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:38.516759 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] PATH_INFO: `/v3/users/9976b8bd89ce495ebe0cc19354e3c076` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:38.517981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9976b8bd89ce495ebe0cc19354e3c076)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:38.519897 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:38.567345 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9976b8bd89ce495ebe0cc19354e3c076'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:38.579931 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9976b8bd89ce495ebe0cc19354e3c076'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:38.589612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9976b8bd89ce495ebe0cc19354e3c076'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:38.596159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9976b8bd89ce495ebe0cc19354e3c076'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:38.596813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9976b8bd89ce495ebe0cc19354e3c076'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:38.602420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1336/2664] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:38 2021] DELETE /identity/v3/users/9976b8bd89ce495ebe0cc19354e3c076 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:38.607245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:38.607533 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:38.607805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:38.626175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:38.627401 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:38.687298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1329/2665] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:38.700557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:38.702080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:38.766822 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b595f8a-cc26-4de0-9b8b-f9374d6d22a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:38.771420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:38.772074 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:38.772350 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:38.772652 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:38.783354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:38.784835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:38.794876 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1337/2666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:39.065811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:39.067640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:39.082342 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b781-b5ea-48b7-b251-93f01e9614aa None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:39.089120 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:39.090544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.090911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.090911 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] PATH_INFO: `/v3/projects/86a7d14fff9641ceacb624eb59f6ef5a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.092251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a7d14fff9641ceacb624eb59f6ef5a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:39.094193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:39.143981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a7d14fff9641ceacb624eb59f6ef5a', 'request_id': 'req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.151684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a7d14fff9641ceacb624eb59f6ef5a', 'request_id': 'req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.157934 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a7d14fff9641ceacb624eb59f6ef5a', 'request_id': 'req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.170228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] The token cache is being invalidate because project 86a7d14fff9641ceacb624eb59f6ef5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:39.170501 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.171337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.173055 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1330/2667] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:39 2021] DELETE /identity/v3/projects/86a7d14fff9641ceacb624eb59f6ef5a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:39.177339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:39.187025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525303-5edd-4484-9959-1cdde3b243c3 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:39.245852 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:39.246747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.247023 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.247293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] PATH_INFO: `/v3/users/709e18cc2ae54997871bb03aa1d5476d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.248580 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] RBAC: Authorizing `identity:delete_user(user_id=709e18cc2ae54997871bb03aa1d5476d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:39.250532 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:39.295845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709e18cc2ae54997871bb03aa1d5476d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.307210 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709e18cc2ae54997871bb03aa1d5476d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.315367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709e18cc2ae54997871bb03aa1d5476d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.322705 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709e18cc2ae54997871bb03aa1d5476d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.323380 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4197f8bb-47bd-4829-8ccf-530ad99b155f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709e18cc2ae54997871bb03aa1d5476d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.329426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1338/2668] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:39 2021] DELETE /identity/v3/users/709e18cc2ae54997871bb03aa1d5476d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:39.632182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:39.633697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:39.650383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd6ba-40c6-4a91-8a0a-3631e8ec93e2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:39.710295 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:39.711211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.711842 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.712110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] PATH_INFO: `/v3/projects/a87e9bc7612140159a4ebd80e70dcd64` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.713393 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87e9bc7612140159a4ebd80e70dcd64)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:39.715551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:39.762275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87e9bc7612140159a4ebd80e70dcd64', 'request_id': 'req-808dfe03-3017-4d7a-a892-6c5b5b6f568a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.769906 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87e9bc7612140159a4ebd80e70dcd64', 'request_id': 'req-808dfe03-3017-4d7a-a892-6c5b5b6f568a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.775677 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87e9bc7612140159a4ebd80e70dcd64', 'request_id': 'req-808dfe03-3017-4d7a-a892-6c5b5b6f568a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.786963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] The token cache is being invalidate because project a87e9bc7612140159a4ebd80e70dcd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:39.787250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.787944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-808dfe03-3017-4d7a-a892-6c5b5b6f568a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:39.789999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1331/2669] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:39 2021] DELETE /identity/v3/projects/a87e9bc7612140159a4ebd80e70dcd64 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:39.795987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.796509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.796840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.815267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:39.816498 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:39.879854 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1339/2670] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:39.888927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.889270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.889776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.910955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:39.912243 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:39.923317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1332/2671] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:39.927826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:39.937612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e95cd-ff6d-415f-8fe7-a2f5ef037442 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:39.942302 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:39.943034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.943314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.943583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.944829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:39.944829 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:39.946245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:39.958016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1340/2672] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:56:39.962801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:39.973053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8d88-1f4a-4299-80b0-d14f0e8a3b41 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:39.978399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:39.979049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:39.979325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:39.979574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:39.980328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:39.982269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.009169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1333/2673] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:39 2021] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:40.013433 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.023414 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1df4-a3ba-43fb-980f-0d93a1998e96 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.088900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.090296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.090782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.091171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.092277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.095010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.119490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1341/2674] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:56:40.123777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.134746 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6832-5d7f-4225-8e19-91ec2479cb37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.140862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.141554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.141862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.142127 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.142858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.144524 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.155385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1334/2675] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:56:40.159460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.170190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f736d7-9dde-4256-8871-3136fac39ca9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.175880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.176574 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.176880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.177146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.177885 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.179485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7aff3-c094-4b58-97cf-c55825a53578 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.190205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1342/2676] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:40.194579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.204967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba03bf-c520-43d9-a8b3-77a911728a96 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.210136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.211129 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.211772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.212043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] PATH_INFO: `/v3/projects/a49fa5873ae14dd69d9780ce4b5c96fc/users/4ff58db670774c99a236ce07d4e6222d/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.226968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49fa5873ae14dd69d9780ce4b5c96fc, user_id=4ff58db670774c99a236ce07d4e6222d, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.229647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.245351 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1335/2677] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:40 2021] PUT /identity/v3/projects/a49fa5873ae14dd69d9780ce4b5c96fc/users/4ff58db670774c99a236ce07d4e6222d/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:40.255936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c763401-3de3-488f-948c-9dffd702594c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.256226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c763401-3de3-488f-948c-9dffd702594c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.256626 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c763401-3de3-488f-948c-9dffd702594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.284467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8c763401-3de3-488f-948c-9dffd702594c None None] MFA Rules not processed for user `4ff58db670774c99a236ce07d4e6222d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:40.285702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8c763401-3de3-488f-948c-9dffd702594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:40.350814 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1343/2678] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:40.355719 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.421515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b142-57c4-48c3-851a-787d15bcdecd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.426583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.427302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.427574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.427839 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.428583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.430447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.458459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1336/2679] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:40.463060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c763401-3de3-488f-948c-9dffd702594c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.474038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c763401-3de3-488f-948c-9dffd702594c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.531010 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.531741 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.532025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.532297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.533116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.535027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.556868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1344/2680] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:40.561674 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.573494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc64a-6aaa-47b3-8fe4-415ce7d0a327 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.582687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.583352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.583634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.584145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.584875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.586814 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.597519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1337/2681] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:40.601973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.618459 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c5c51-ab1f-4f98-8c3a-b96d1ebfc532 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.624606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.625682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.625979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.626358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] PATH_INFO: `/v3/projects/41c28401a16a4e4f841cd01e866afe52/users/2a4edebd5f9d4eedbceb035064e7337d/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.643649 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c28401a16a4e4f841cd01e866afe52, user_id=2a4edebd5f9d4eedbceb035064e7337d, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.646494 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.659903 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1345/2682] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:40 2021] PUT /identity/v3/projects/41c28401a16a4e4f841cd01e866afe52/users/2a4edebd5f9d4eedbceb035064e7337d/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:40.663836 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.673887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b06159-69d9-4b81-80a8-f49fcca14eb7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.735471 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.736155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.736452 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.736862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.737600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.739238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.749070 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1338/2683] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:40.753287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.764930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fad11-502b-4a7b-b304-fc5f9fc9e96e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.769771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.770664 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.771085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.771213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] PATH_INFO: `/v3/projects/41c28401a16a4e4f841cd01e866afe52/users/2a4edebd5f9d4eedbceb035064e7337d/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.773564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c28401a16a4e4f841cd01e866afe52, user_id=2a4edebd5f9d4eedbceb035064e7337d, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.776199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf0d50-4d19-4961-b195-60ac5f8adc57 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.782627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.784345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:40.789173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1346/2684] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:40 2021] PUT /identity/v3/projects/41c28401a16a4e4f841cd01e866afe52/users/2a4edebd5f9d4eedbceb035064e7337d/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:40.797172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6ed8-4426-4bad-8bb9-0ef20bebb2d8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:40.800573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.801073 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.801310 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.827316 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] MFA Rules not processed for user `2a4edebd5f9d4eedbceb035064e7337d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:40.828579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:40.853442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:40.854303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.854579 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.854891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] PATH_INFO: `/v3/users/07646899013d49b1a741554408f5297c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.856203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07646899013d49b1a741554408f5297c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:40.858202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:40.894474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1347/2685] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:40.904937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07646899013d49b1a741554408f5297c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:40.905609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07646899013d49b1a741554408f5297c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:40.910121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:40.911531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:40.913259 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07646899013d49b1a741554408f5297c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:40.926764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07646899013d49b1a741554408f5297c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:40.935382 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72979453-8bac-48e6-bcd6-2a8a2ce43187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07646899013d49b1a741554408f5297c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:40.941789 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1339/2686] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:40 2021] DELETE /identity/v3/users/07646899013d49b1a741554408f5297c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:40.947024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:40.947324 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:40.947602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:40.965899 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:40.967081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:40.969398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c70fc0-519c-4b91-afa5-37af8bce6ef5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:41.016673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:41.017335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:41.017641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:41.017955 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:41.019831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:41.025263 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1340/2687] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:41.035609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:41.037092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:41.081304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:41.082767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:41.092050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813b92-0255-467a-8c56-d0ad9ca01b14 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:41.092862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1348/2688] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:40 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:41.095889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:41.096574 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:41.096891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:41.097166 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:41.106705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:41.108154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:41.117876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1341/2689] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:41.168891 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:41.170382 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:41.181604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ddf8-6315-4007-ab54-abeec88ecf86 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:41.185925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:41.186583 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:41.186861 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:41.187176 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:41.189183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:41.252360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:41.256317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:41.264038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1349/2690] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:41 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:41.384938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:41.387031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:41.403598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099cfa9-20f5-40df-9576-d3f08a4dfc29 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:41.411705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:41.412820 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:41.413254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:41.413647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] PATH_INFO: `/v3/projects/60202ca2ab5d414885689cab973262f2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:41.415176 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60202ca2ab5d414885689cab973262f2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:41.417849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:41.468315 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60202ca2ab5d414885689cab973262f2', 'request_id': 'req-0a5599f0-5561-4863-8707-30b711bb4820'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.478181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60202ca2ab5d414885689cab973262f2', 'request_id': 'req-0a5599f0-5561-4863-8707-30b711bb4820'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.489539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60202ca2ab5d414885689cab973262f2', 'request_id': 'req-0a5599f0-5561-4863-8707-30b711bb4820'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.508798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] The token cache is being invalidate because project 60202ca2ab5d414885689cab973262f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:41.509101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.509887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.511929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1342/2691] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:41 2021] DELETE /identity/v3/projects/60202ca2ab5d414885689cab973262f2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:41.516144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:41.529032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f8f3-0e45-4cd8-8c92-b3a75a9ee829 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:41.593781 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:41.594695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:41.594972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:41.595242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] PATH_INFO: `/v3/users/ca4147e40e0a478583c326411b9b8fd5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:41.596477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4147e40e0a478583c326411b9b8fd5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:41.598421 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:41.658561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4147e40e0a478583c326411b9b8fd5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.673239 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4147e40e0a478583c326411b9b8fd5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.685095 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4147e40e0a478583c326411b9b8fd5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.692284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4147e40e0a478583c326411b9b8fd5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.692892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-83f0a67f-f4c6-4ee8-ad18-81e79e135861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4147e40e0a478583c326411b9b8fd5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:41.698917 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1350/2692] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:41 2021] DELETE /identity/v3/users/ca4147e40e0a478583c326411b9b8fd5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:41.990319 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:41.992015 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:42.005715 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5599f0-5561-4863-8707-30b711bb4820 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.067167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.068045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.068325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.068628 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] PATH_INFO: `/v3/projects/d047307aecd24d9381192df2c8b1a605` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.069896 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d047307aecd24d9381192df2c8b1a605)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.071821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.122076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd047307aecd24d9381192df2c8b1a605', 'request_id': 'req-13d3c1b6-d79c-4df5-980f-0a2612a418e7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:42.130931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd047307aecd24d9381192df2c8b1a605', 'request_id': 'req-13d3c1b6-d79c-4df5-980f-0a2612a418e7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:42.138067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd047307aecd24d9381192df2c8b1a605', 'request_id': 'req-13d3c1b6-d79c-4df5-980f-0a2612a418e7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:42.149257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] The token cache is being invalidate because project d047307aecd24d9381192df2c8b1a605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:42.149540 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:42.150279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-13d3c1b6-d79c-4df5-980f-0a2612a418e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:42.151954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1343/2693] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:41 2021] DELETE /identity/v3/projects/d047307aecd24d9381192df2c8b1a605 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:42.160297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.160857 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.161016 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.181273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:42.182484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:42.258077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1351/2694] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:42.267357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.267637 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.267907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.290266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:42.292051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:42.301909 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1344/2695] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:42.306423 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.316632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a71c-2eb0-4585-80c4-87e0bffe93f7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.322696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.323351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.323744 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.324128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.324809 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:42.325119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.326723 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.339013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1352/2696] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:56:42.343607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.353213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d35e-9ca8-430f-ba07-7b84a0285bf3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.359274 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.359925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.360202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.360487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.361206 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.363142 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.392009 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1345/2697] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:42 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:42.396866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.411661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22404-67c6-41f6-8204-510ca046826d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.468835 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.469499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.469779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.470051 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.470749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.472711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.493478 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1353/2698] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:42 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:42.498348 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.512318 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210703f5-5b56-4dad-91cc-ddfe871048c9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.517695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.518442 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.518811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.519145 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.519952 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.521651 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.535729 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1346/2699] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:42.537020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.547711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62730fd8-bae8-4854-974f-df65b8e4bf28 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.558751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.559601 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.559866 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.560134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.560907 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.563033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169057-dbc7-4905-9e12-5956a6708228 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.573508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1354/2700] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:42.578752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.590806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794bd3-686a-47fa-91d2-9b0cc0c78d7a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.596624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.607310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.607310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.607310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] PATH_INFO: `/v3/projects/0ece99a749ca4f7e923e92562d48215f/users/c12b509b650b4535a29a75df00f7b47a/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.616146 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ece99a749ca4f7e923e92562d48215f, user_id=c12b509b650b4535a29a75df00f7b47a, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.618800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.634917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1347/2701] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:42 2021] PUT /identity/v3/projects/0ece99a749ca4f7e923e92562d48215f/users/c12b509b650b4535a29a75df00f7b47a/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:42.647544 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.647824 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.648071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.681945 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] MFA Rules not processed for user `c12b509b650b4535a29a75df00f7b47a`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:42.683244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:42.749887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1355/2702] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:42 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:42.760519 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:42.763162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:42.822252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6883fb-5ab6-4f97-8bdd-fa7a85b5200c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:42.826699 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:42.827352 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:42.827643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:42.827914 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:42.837125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:42.838587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:42.848630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1348/2703] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:42 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:45.302767 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:45.304168 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:45.373329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:45.373856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b424dc-4c53-43e3-9218-7499a814a3f7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:45.378602 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:45.379479 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.379804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.380083 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] PATH_INFO: `/v3/users/4ff58db670774c99a236ce07d4e6222d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.381535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff58db670774c99a236ce07d4e6222d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:45.383527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:45.384213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c08af-1d5e-4077-975a-c6c7ac7fa21e service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:45.388983 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:45.389931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.390212 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.390486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] PATH_INFO: `/v3/users/c12b509b650b4535a29a75df00f7b47a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.391706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12b509b650b4535a29a75df00f7b47a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:45.393763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:45.435148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff58db670774c99a236ce07d4e6222d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.444199 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12b509b650b4535a29a75df00f7b47a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.444872 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12b509b650b4535a29a75df00f7b47a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.446938 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff58db670774c99a236ce07d4e6222d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.452713 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12b509b650b4535a29a75df00f7b47a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.455936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff58db670774c99a236ce07d4e6222d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.463093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff58db670774c99a236ce07d4e6222d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.463739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9fb2ee19-dd9a-4275-96dc-5630b852114e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff58db670774c99a236ce07d4e6222d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.465317 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12b509b650b4535a29a75df00f7b47a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.471111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1356/2704] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:45 2021] DELETE /identity/v3/users/4ff58db670774c99a236ce07d4e6222d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:45.474250 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ce46691b-6ef2-4164-85bb-7b41d8a81e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12b509b650b4535a29a75df00f7b47a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:45.476287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.476619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.476922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.481662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1349/2705] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:45 2021] DELETE /identity/v3/users/c12b509b650b4535a29a75df00f7b47a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:45.486111 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.486402 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.486684 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.494803 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:45.496058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:45.504245 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:45.505445 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:45.554432 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1357/2706] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:45.563193 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1350/2707] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:45.565065 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:45.567087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:45.572960 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:45.575174 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:45.622185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745684-ebc5-4bc8-a146-60df1e62b301 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:45.625864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:45.626517 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.626801 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.627077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.631511 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d9722-72ad-4cfb-8f39-43c83f5d692b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:45.635048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:45.635691 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:45.635970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:45.636174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:45.636340 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:45.637812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:45.645090 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:45.646510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:45.647041 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1358/2708] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:45.656626 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1351/2709] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:56:45.997839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:45.999436 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.004072 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.005878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.018087 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0b0e8-2e84-4759-91f8-fe8fd7acd843 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.024092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.025020 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.025305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.025585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] PATH_INFO: `/v3/projects/0ece99a749ca4f7e923e92562d48215f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.026805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ece99a749ca4f7e923e92562d48215f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.028782 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.029378 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84239a-6b84-48f2-b56e-ec2ebb14a44d service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.035238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.036387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.037021 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.037388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] PATH_INFO: `/v3/projects/a49fa5873ae14dd69d9780ce4b5c96fc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.039081 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49fa5873ae14dd69d9780ce4b5c96fc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.042204 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.077359 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ece99a749ca4f7e923e92562d48215f', 'request_id': 'req-1ac20738-5bd4-4dda-9bb8-183ffb72a126'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.083232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ece99a749ca4f7e923e92562d48215f', 'request_id': 'req-1ac20738-5bd4-4dda-9bb8-183ffb72a126'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.089831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ece99a749ca4f7e923e92562d48215f', 'request_id': 'req-1ac20738-5bd4-4dda-9bb8-183ffb72a126'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.092453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49fa5873ae14dd69d9780ce4b5c96fc', 'request_id': 'req-0cdd312f-5cd8-4054-855d-0a59d0773f7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.099993 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49fa5873ae14dd69d9780ce4b5c96fc', 'request_id': 'req-0cdd312f-5cd8-4054-855d-0a59d0773f7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.102393 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] The token cache is being invalidate because project 0ece99a749ca4f7e923e92562d48215f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:46.102678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.103306 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1ac20738-5bd4-4dda-9bb8-183ffb72a126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.105277 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1359/2710] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:45 2021] DELETE /identity/v3/projects/0ece99a749ca4f7e923e92562d48215f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:46.105555 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49fa5873ae14dd69d9780ce4b5c96fc', 'request_id': 'req-0cdd312f-5cd8-4054-855d-0a59d0773f7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.110476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6be9-c33e-4135-b149-ef54d15ae36b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.110761 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6be9-c33e-4135-b149-ef54d15ae36b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.111034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6be9-c33e-4135-b149-ef54d15ae36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.116859 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] The token cache is being invalidate because project a49fa5873ae14dd69d9780ce4b5c96fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:46.117155 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.117931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.119459 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1352/2711] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:46 2021] DELETE /identity/v3/projects/a49fa5873ae14dd69d9780ce4b5c96fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:46.123963 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.125360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.133817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-077a6be9-c33e-4135-b149-ef54d15ae36b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:46.134981 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-077a6be9-c33e-4135-b149-ef54d15ae36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.187730 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd312f-5cd8-4054-855d-0a59d0773f7a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.193198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1360/2712] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:46.193343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.199676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.199676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.199676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] PATH_INFO: `/v3/users/2a4edebd5f9d4eedbceb035064e7337d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.199676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4edebd5f9d4eedbceb035064e7337d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.199676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.201025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.201314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.201588 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.219985 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:46.221236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.230490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1361/2713] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:46.234696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.244077 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4fc6-8608-4953-9485-44fe57ed155f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.246903 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4edebd5f9d4eedbceb035064e7337d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.247700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4edebd5f9d4eedbceb035064e7337d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.249070 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.249734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.250013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.250314 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.251052 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:46.251358 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.253017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.254706 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4edebd5f9d4eedbceb035064e7337d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.267935 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1362/2714] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:56:46.268132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4edebd5f9d4eedbceb035064e7337d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.268986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.275572 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4edebd5f9d4eedbceb035064e7337d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.279808 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b5066-56e2-478c-89f8-0e47a85b0658 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.282676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1353/2715] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:56:46 2021] DELETE /identity/v3/users/2a4edebd5f9d4eedbceb035064e7337d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:56:46.284684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.285338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.285624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.286055 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.286760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.288689 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.316251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1363/2716] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:46.320470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.321961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.406117 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e39a8-eb19-4d2e-afc5-6a9b60c00874 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.464063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.464840 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.465119 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.465389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.466088 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.467999 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.491642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1354/2717] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:46.492856 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.502951 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe15d6-612c-4499-8fca-edbedc9ba5c1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.507503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.508214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.508483 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.508751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.509698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.511401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.522232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1364/2718] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:46.526431 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.537530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84246-dca8-4454-8f9c-38ee424ed05e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.544708 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.545661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.545893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.546182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.546933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.548692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.563486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1355/2719] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:56:46.563662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.563930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.565985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.576826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc225d3-8c8b-421d-96b4-99a4cfb72879 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.581826 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e774a5-195f-4cd6-a7f1-2a7301f2fbe8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.583062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.584022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.584305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.584612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] PATH_INFO: `/v3/projects/cf54d67a244c4162b986a03b51b95801/users/b90055a86e0a4bda920bc4de6e8ae9f4/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.587334 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.588257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.588577 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.588859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] PATH_INFO: `/v3/projects/41c28401a16a4e4f841cd01e866afe52` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.590555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c28401a16a4e4f841cd01e866afe52)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.592645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.601696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf54d67a244c4162b986a03b51b95801, user_id=b90055a86e0a4bda920bc4de6e8ae9f4, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.604412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dee6a-cf0e-47ae-8c5b-4380ab96a6a2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.620010 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1356/2720] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:46 2021] PUT /identity/v3/projects/cf54d67a244c4162b986a03b51b95801/users/b90055a86e0a4bda920bc4de6e8ae9f4/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:46.631537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.631970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.632271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.641627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c28401a16a4e4f841cd01e866afe52', 'request_id': 'req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.647389 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c28401a16a4e4f841cd01e866afe52', 'request_id': 'req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.654260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c28401a16a4e4f841cd01e866afe52', 'request_id': 'req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.659060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] MFA Rules not processed for user `b90055a86e0a4bda920bc4de6e8ae9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:46.660589 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.670490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] The token cache is being invalidate because project 41c28401a16a4e4f841cd01e866afe52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:56:46.670785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.671439 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a5f5e441-980e-4126-8b84-8b0ac79c0a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:56:46.673220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1365/2721] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:56:46 2021] DELETE /identity/v3/projects/41c28401a16a4e4f841cd01e866afe52 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:46.679711 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b07af-f715-4536-9196-8256287998d2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.680005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b07af-f715-4536-9196-8256287998d2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.680267 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b07af-f715-4536-9196-8256287998d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.698543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e68b07af-f715-4536-9196-8256287998d2 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:46.700337 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e68b07af-f715-4536-9196-8256287998d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.733538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1357/2722] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:46.752703 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.754321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.771363 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1366/2723] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:46.778906 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.779198 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.779484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.798182 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:46.799386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:46.807245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1367/2724] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:56:46.811716 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.814267 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb64237-d2a7-4c6c-9ffb-f0920e8ae546 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.817879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.818521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.818801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.819066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.821088 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca65e-8707-4455-adfe-564d7b54c4e6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.826025 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.826770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.827079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.827341 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.827955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.828066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:56:46.828351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.829690 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.830001 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.839099 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1358/2725] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:46.842368 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1368/2726] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:56:46.846829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.857202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e138ef4-b00a-4324-adeb-e84b77d345bb service glance] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.862169 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.862829 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.863110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.863388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.864096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.866020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.893290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1359/2727] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:46.897472 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:46.907708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7df-0419-400d-bc42-2e92e7711fb2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:46.963838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:46.964784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:46.965200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:46.965487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:46.966220 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:46.968181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:46.992233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1369/2728] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:46 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:56:46.993469 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:47.004857 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f878-ae71-432d-aa5f-7e2dfb53bee5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:47.010667 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:47.011450 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:47.011775 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:47.012175 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:47.013757 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:47.014621 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:47.029376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1360/2729] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:47.030557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:47.040611 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f33e22-aaa3-4fea-9df0-a9ec493acfc5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:47.045619 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:47.046284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:47.046565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:47.046840 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:47.047585 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:47.049290 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54cab-4b5c-45ad-b05e-880b5d0dcd2e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:47.059213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1370/2730] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:47.063460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:47.073467 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516254f0-b68c-4352-8442-50a9e9887a9c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:47.078396 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:47.079288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:47.079694 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:47.079976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] PATH_INFO: `/v3/projects/2198ae09091a42f891ff87f172111503/users/49ba2c19a64c4953a4ae43d604e00203/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:47.095584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2198ae09091a42f891ff87f172111503, user_id=49ba2c19a64c4953a4ae43d604e00203, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:47.098357 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:47.111492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1361/2731] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:47 2021] PUT /identity/v3/projects/2198ae09091a42f891ff87f172111503/users/49ba2c19a64c4953a4ae43d604e00203/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:47.116708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce37-2a02-48c2-8345-9bf3c0ede0c8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:47.117078 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce37-2a02-48c2-8345-9bf3c0ede0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:47.117366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce37-2a02-48c2-8345-9bf3c0ede0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:47.136005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f624ce37-2a02-48c2-8345-9bf3c0ede0c8 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:47.137407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f624ce37-2a02-48c2-8345-9bf3c0ede0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:47.196060 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1371/2732] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:47.206627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:47.208587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:47.271039 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee2e0-84f4-4e2d-8a91-f70af03f14e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:47.275278 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:47.275932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:47.276213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:47.276516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:47.287300 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:47.288787 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:47.299092 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1362/2733] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:48.204253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.204880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.204880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.236021 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] MFA Rules not processed for user `49ba2c19a64c4953a4ae43d604e00203`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:48.237294 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:48.311612 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1372/2734] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:48.316160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.329581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedd4fe-ac54-4d6a-a1a1-839431bd8ed9 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.334682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.336770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.337053 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.337326 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.338048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.340761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.369008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1363/2735] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:56:48 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:48.373768 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.384381 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05861-7c50-4763-be24-8ec959df1496 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.445468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.446221 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.446505 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.446783 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.447661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.449640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.475312 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1373/2736] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:56:48 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:56:48.476887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.487849 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4c68-de5c-4273-ab90-7910f3ee47e5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.492848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.493779 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.494060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.494444 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.495189 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.497002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.513530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1364/2737] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:48.515635 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.525683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6177a-8bc0-4609-93e2-dc3b6611341f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.530987 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.531872 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.532148 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.532450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] PATH_INFO: `/v3/projects/2abb6bba92f9482397cdeb9c69eb732c/users/7a3c52722b3646c0aded577b8e9c407f/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.546815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abb6bba92f9482397cdeb9c69eb732c, user_id=7a3c52722b3646c0aded577b8e9c407f, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.549536 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.564274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1374/2738] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:48 2021] PUT /identity/v3/projects/2abb6bba92f9482397cdeb9c69eb732c/users/7a3c52722b3646c0aded577b8e9c407f/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:48.568487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.579203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b72387-4ab9-429b-acbb-441cf440d2f0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.645126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.645803 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.646060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.646417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.647163 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.648805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601bb1-cb0b-493d-a2f7-622ab41e1141 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.659441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1365/2739] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:56:48.663849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:48.675097 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd67a-f1b2-4f37-8723-40dd63d3769e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:48.681501 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:48.682732 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:48.683232 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:48.683572 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] PATH_INFO: `/v3/projects/2abb6bba92f9482397cdeb9c69eb732c/users/7a3c52722b3646c0aded577b8e9c407f/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:48.686123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abb6bba92f9482397cdeb9c69eb732c, user_id=7a3c52722b3646c0aded577b8e9c407f, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:48.688802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:48.700133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1375/2740] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:56:48 2021] PUT /identity/v3/projects/2abb6bba92f9482397cdeb9c69eb732c/users/7a3c52722b3646c0aded577b8e9c407f/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:56:49.359838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:49.359838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:49.359838 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:49.391080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] MFA Rules not processed for user `7a3c52722b3646c0aded577b8e9c407f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:56:49.392310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:49.464539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1366/2741] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:56:49 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:56:49.475896 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:49.478085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:56:49.541991 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92ced-b802-47c1-bcc3-d595395444dc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:49.546463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:49.547127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:49.547399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:49.547653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:49.605605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:49.607271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:49.616338 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1376/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:49 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:56:50.977073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:56:50.988676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955c61-6b98-400b-b87a-a9c70750c202 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:56:50.992758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:56:50.993381 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:56:50.993673 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:56:50.993927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:56:51.006751 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:56:51.008617 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:56:51.022105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1367/2743] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:56:50 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:04.135531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:04.204053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0305ea0-a147-47a2-b715-731d33209dd2 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:04.208914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:04.209927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:04.210268 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:04.210584 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] PATH_INFO: `/v3/users/49ba2c19a64c4953a4ae43d604e00203` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:04.212486 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ba2c19a64c4953a4ae43d604e00203)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:04.214524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:04.265034 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ba2c19a64c4953a4ae43d604e00203'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.277426 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ba2c19a64c4953a4ae43d604e00203'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.285864 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ba2c19a64c4953a4ae43d604e00203'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.292598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ba2c19a64c4953a4ae43d604e00203'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.293245 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ba2c19a64c4953a4ae43d604e00203'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.298952 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1377/2744] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:04 2021] DELETE /identity/v3/users/49ba2c19a64c4953a4ae43d604e00203 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:04.474272 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:04.491153 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d62c0-c12a-473d-b575-3ffc4424ce87 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:04.553587 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:04.554458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:04.554743 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:04.555018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] PATH_INFO: `/v3/projects/2198ae09091a42f891ff87f172111503` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:04.556241 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2198ae09091a42f891ff87f172111503)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:04.558197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:04.607152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2198ae09091a42f891ff87f172111503', 'request_id': 'req-98a5f35c-455c-40ff-a7ef-c0393f1366df'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.615334 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2198ae09091a42f891ff87f172111503', 'request_id': 'req-98a5f35c-455c-40ff-a7ef-c0393f1366df'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.621049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2198ae09091a42f891ff87f172111503', 'request_id': 'req-98a5f35c-455c-40ff-a7ef-c0393f1366df'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.631976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] The token cache is being invalidate because project 2198ae09091a42f891ff87f172111503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:04.632265 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.632932 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.634460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1368/2745] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:04 2021] DELETE /identity/v3/projects/2198ae09091a42f891ff87f172111503 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:04.638683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:04.640557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:04.654123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd589d-f45e-45f5-9029-7b7b83dba4e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:04.712758 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:04.713641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:04.713925 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:04.714173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] PATH_INFO: `/v3/users/7a3c52722b3646c0aded577b8e9c407f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:04.715378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3c52722b3646c0aded577b8e9c407f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:04.717399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:04.767084 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3c52722b3646c0aded577b8e9c407f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.778604 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3c52722b3646c0aded577b8e9c407f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.787739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3c52722b3646c0aded577b8e9c407f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.794575 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3c52722b3646c0aded577b8e9c407f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.795217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0dd4e4b7-c495-4cff-9481-5d549253a7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3c52722b3646c0aded577b8e9c407f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:04.801171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1378/2746] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:04 2021] DELETE /identity/v3/users/7a3c52722b3646c0aded577b8e9c407f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:04.977592 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:04.979051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:04.993339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5f35c-455c-40ff-a7ef-c0393f1366df admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.050762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.051623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.051907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.052180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] PATH_INFO: `/v3/projects/2abb6bba92f9482397cdeb9c69eb732c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.053496 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abb6bba92f9482397cdeb9c69eb732c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.055383 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.108210 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abb6bba92f9482397cdeb9c69eb732c', 'request_id': 'req-48faabda-e75a-43b7-94de-67ebdb04aa79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.118778 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abb6bba92f9482397cdeb9c69eb732c', 'request_id': 'req-48faabda-e75a-43b7-94de-67ebdb04aa79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.125419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abb6bba92f9482397cdeb9c69eb732c', 'request_id': 'req-48faabda-e75a-43b7-94de-67ebdb04aa79'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.136532 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] The token cache is being invalidate because project 2abb6bba92f9482397cdeb9c69eb732c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:05.136835 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.137513 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-48faabda-e75a-43b7-94de-67ebdb04aa79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.139042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1369/2747] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:04 2021] DELETE /identity/v3/projects/2abb6bba92f9482397cdeb9c69eb732c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:05.145053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.145555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.145555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.164490 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:05.165625 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:05.228166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1379/2748] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:05.236777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.237060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.237329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.255502 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:05.256718 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:05.264927 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1370/2749] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:05.269273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.278899 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f90d72-fef6-4732-bcab-0f1c3581ae2c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.284233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.285003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.285275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.285543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.286281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:57:05.286581 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.288159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.299800 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1380/2750] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:57:05.304580 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.313353 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de39f3-7d5c-42a3-9b8a-d0c38d2319f5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.318269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.318917 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.319195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.319462 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.320164 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.322063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.355440 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1371/2751] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:57:05.360552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.370668 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa54ad2-3703-4c3a-aa6e-07141319d65d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.428422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.429123 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.429398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.429666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.430378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.432276 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.457535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1381/2752] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:57:05.458825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.469486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ea7d-5a38-4487-be0d-2fcc0aba9117 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.474724 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.475455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.475748 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.476161 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.476948 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.478551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.489544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1372/2753] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:05.493713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.504067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6727dd-a9da-4395-83dc-6059db6df1e1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.509702 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.510539 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.510823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.511159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.511947 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.513623 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486e3b3-9bc8-40db-a504-f86db5a3b4d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.527117 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1382/2754] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:05.528632 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.538830 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1603-20ae-4f19-bb01-1784cc297cb8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.543560 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.544514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.544802 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.545106 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] PATH_INFO: `/v3/projects/3da1564162ec4bad96dc44ef59ed87fa/users/ef091f143b254ea888d910d557541dd8/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.562124 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da1564162ec4bad96dc44ef59ed87fa, user_id=ef091f143b254ea888d910d557541dd8, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.565720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.581232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1373/2755] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:05 2021] PUT /identity/v3/projects/3da1564162ec4bad96dc44ef59ed87fa/users/ef091f143b254ea888d910d557541dd8/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:05.593005 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.593400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.593557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.621003 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] MFA Rules not processed for user `ef091f143b254ea888d910d557541dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:05.622203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:05.689740 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1383/2756] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:05.700514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.702358 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:05.759627 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475630d-f464-43db-ad4d-8a6ab12c09a4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.763861 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.764665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.764921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.765203 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.773763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.775188 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed3bf-8f75-4ccf-90c0-3524b227dbb7 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.783865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1374/2757] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:05 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:05.803971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:05.873994 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f90e-3ade-414e-851c-c207604563c4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:05.879235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:05.880116 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.880394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.880699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] PATH_INFO: `/v3/users/ef091f143b254ea888d910d557541dd8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:05.881979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef091f143b254ea888d910d557541dd8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:05.883887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:05.934920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef091f143b254ea888d910d557541dd8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.955500 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef091f143b254ea888d910d557541dd8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.968250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef091f143b254ea888d910d557541dd8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.975817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef091f143b254ea888d910d557541dd8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.976594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef091f143b254ea888d910d557541dd8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:05.982959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1384/2758] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:05 2021] DELETE /identity/v3/users/ef091f143b254ea888d910d557541dd8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:05.989172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:05.989463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:05.989726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.007413 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:06.008686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:06.069853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1375/2759] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:06.080731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.082282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:06.150071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0774d2-48d4-45ff-a4c1-e237967a23d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.154684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.155357 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.155621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.155888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.166039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.167524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8506a-a9ee-4de8-bdeb-f170dc356c9c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.177048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1385/2760] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:06.457856 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.459695 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:06.474083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954d15b-dcd3-4670-a6a2-5d7a2d2b973f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.479411 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.480288 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.480671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.480937 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] PATH_INFO: `/v3/projects/3da1564162ec4bad96dc44ef59ed87fa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.482255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da1564162ec4bad96dc44ef59ed87fa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.485065 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.532969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da1564162ec4bad96dc44ef59ed87fa', 'request_id': 'req-170de421-1315-4754-88fd-9fe349601bae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:06.542568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da1564162ec4bad96dc44ef59ed87fa', 'request_id': 'req-170de421-1315-4754-88fd-9fe349601bae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:06.548049 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da1564162ec4bad96dc44ef59ed87fa', 'request_id': 'req-170de421-1315-4754-88fd-9fe349601bae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:06.558732 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] The token cache is being invalidate because project 3da1564162ec4bad96dc44ef59ed87fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:06.559014 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:06.559642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-170de421-1315-4754-88fd-9fe349601bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:06.561261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1376/2761] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:06 2021] DELETE /identity/v3/projects/3da1564162ec4bad96dc44ef59ed87fa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:06.571911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.572200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.572508 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.591351 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:06.592718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:06.661820 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1386/2762] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:06.669942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.670229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.670494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.696483 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:06.697843 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:06.717170 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.720624 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1377/2763] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:06.730662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a09df8-5a75-4840-9d46-7e2de8400e3f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.735874 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.736642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.736932 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.737208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.737979 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:57:06.738287 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.739895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.752284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1387/2764] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:57:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:57:06.756716 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.767255 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2edb3-35dd-40da-acf9-ba6e06f496cf None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.772591 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.773405 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.773686 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.773961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.775083 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.777233 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.807325 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1378/2765] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:57:06 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:57:06.808633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.820140 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe32b9a-3043-4375-89a8-052b98a42374 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.882564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.883241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.883519 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.883791 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.884537 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.886457 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.906031 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1388/2766] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:57:06 2021] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:57:06.910495 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.921197 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc6e94-71e5-47e2-ab36-64c9712174c9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.925805 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.926468 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.926752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.927029 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.927767 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.929403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.939877 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1379/2767] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:06.946254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.958632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08255-5932-4f92-9d6f-2d5aca008ce4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.964839 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.965504 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.965778 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.966046 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:06.966804 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:06.968411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ade1-1016-42a7-82fe-38b6d6a3eb03 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:06.978643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1389/2768] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:06.982747 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:06.993253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb42e-647c-4e0a-b3bc-4a10460f7d4f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:06.998497 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:06.999399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:06.999678 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:06.999950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] PATH_INFO: `/v3/projects/23cacda6b3ef43af87e379b3a1276648/users/0cd879112ba74709a71e3e9e7aa8622b/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:07.014834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cacda6b3ef43af87e379b3a1276648, user_id=0cd879112ba74709a71e3e9e7aa8622b, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:07.017634 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:07.032710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1380/2769] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:06 2021] PUT /identity/v3/projects/23cacda6b3ef43af87e379b3a1276648/users/0cd879112ba74709a71e3e9e7aa8622b/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:07.042973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:07.043260 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:07.043541 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:07.072135 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] MFA Rules not processed for user `0cd879112ba74709a71e3e9e7aa8622b`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:07.073435 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:07.143530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1390/2770] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:07.154222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:07.156618 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:07.217742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641ec4-d94f-41b2-804c-52fa1271aa18 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:07.222852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:07.223536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:07.223811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:07.224078 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:07.234028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:07.235458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:07.244740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1381/2771] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:07 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:17.707815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:17.709713 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:17.779429 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:17.779946 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45e91-f36a-44e5-ac81-94e5cee5153b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:17.785920 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:17.786914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:17.787193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:17.787460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] PATH_INFO: `/v3/users/b90055a86e0a4bda920bc4de6e8ae9f4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:17.788810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90055a86e0a4bda920bc4de6e8ae9f4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:17.790630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388aea-3374-4be4-8409-80cbd87c7623 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:17.790762 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:17.795399 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:17.796266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:17.796566 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:17.796832 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] PATH_INFO: `/v3/users/0cd879112ba74709a71e3e9e7aa8622b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:17.798069 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd879112ba74709a71e3e9e7aa8622b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:17.800076 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:17.841288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90055a86e0a4bda920bc4de6e8ae9f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.846976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd879112ba74709a71e3e9e7aa8622b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.848186 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd879112ba74709a71e3e9e7aa8622b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.853152 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90055a86e0a4bda920bc4de6e8ae9f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.855518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd879112ba74709a71e3e9e7aa8622b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.861685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90055a86e0a4bda920bc4de6e8ae9f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.868050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd879112ba74709a71e3e9e7aa8622b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.868420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90055a86e0a4bda920bc4de6e8ae9f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.869111 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0fc8583e-7748-4c15-a368-bd3e1ff14ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90055a86e0a4bda920bc4de6e8ae9f4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.875107 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1391/2772] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:17 2021] DELETE /identity/v3/users/b90055a86e0a4bda920bc4de6e8ae9f4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:17.876938 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-72ccc05f-5aab-4f4c-bd86-10cb477b15a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd879112ba74709a71e3e9e7aa8622b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:17.880090 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:17.880372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:17.880673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:17.883374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1382/2773] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:17 2021] DELETE /identity/v3/users/0cd879112ba74709a71e3e9e7aa8622b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:17.887642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:17.887931 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:17.888323 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:17.902779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:17.904112 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:17.907057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:17.908297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:17.967154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1392/2774] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:17.976810 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1383/2775] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:17.977269 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:17.979477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:17.986458 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:17.987921 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.034823 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4fc08-fd04-4c5f-97f4-d762caab6853 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.038347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.038989 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.039271 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.039543 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.046614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b646223-d681-4f7f-bd6e-a39683fb70ee None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.048708 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.050169 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.050504 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.051237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.051516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.051785 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.060045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1393/2776] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:57:18.060953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.062480 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.072470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1384/2777] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:57:18.423346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.425696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.438888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.440419 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.442497 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3be851-b3e9-474a-8d53-2f7ae837db56 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.447476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.448330 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.448770 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.449067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] PATH_INFO: `/v3/projects/cf54d67a244c4162b986a03b51b95801` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.450291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf54d67a244c4162b986a03b51b95801)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.452412 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.455182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851cf50-e1ec-4903-8a8d-ffa93b4a275e service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.461816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.462808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.463126 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.463537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] PATH_INFO: `/v3/projects/23cacda6b3ef43af87e379b3a1276648` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.464975 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cacda6b3ef43af87e379b3a1276648)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.466945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.504328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf54d67a244c4162b986a03b51b95801', 'request_id': 'req-6484af14-a855-45c0-b198-a6b2680679a1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.509834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf54d67a244c4162b986a03b51b95801', 'request_id': 'req-6484af14-a855-45c0-b198-a6b2680679a1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.516162 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf54d67a244c4162b986a03b51b95801', 'request_id': 'req-6484af14-a855-45c0-b198-a6b2680679a1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.518647 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cacda6b3ef43af87e379b3a1276648', 'request_id': 'req-6224f241-1fa9-4536-bb2e-3a23355ecca6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.526330 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cacda6b3ef43af87e379b3a1276648', 'request_id': 'req-6224f241-1fa9-4536-bb2e-3a23355ecca6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.528969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] The token cache is being invalidate because project cf54d67a244c4162b986a03b51b95801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:18.529255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.529892 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6484af14-a855-45c0-b198-a6b2680679a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.531563 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1394/2778] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:18 2021] DELETE /identity/v3/projects/cf54d67a244c4162b986a03b51b95801 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:18.531892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cacda6b3ef43af87e379b3a1276648', 'request_id': 'req-6224f241-1fa9-4536-bb2e-3a23355ecca6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.537592 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d0af-5c0f-47df-a86b-420c5297f47d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.537941 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d0af-5c0f-47df-a86b-420c5297f47d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.538240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d0af-5c0f-47df-a86b-420c5297f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.545815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] The token cache is being invalidate because project 23cacda6b3ef43af87e379b3a1276648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:18.546107 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.546753 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6224f241-1fa9-4536-bb2e-3a23355ecca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:18.548292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1385/2779] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:18 2021] DELETE /identity/v3/projects/23cacda6b3ef43af87e379b3a1276648 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:18.554138 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41e99-37d6-4985-b366-5a360595daa4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.554422 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41e99-37d6-4985-b366-5a360595daa4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.554697 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41e99-37d6-4985-b366-5a360595daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.556780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ebb8d0af-5c0f-47df-a86b-420c5297f47d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:18.557970 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ebb8d0af-5c0f-47df-a86b-420c5297f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.572385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5cb41e99-37d6-4985-b366-5a360595daa4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:18.573613 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5cb41e99-37d6-4985-b366-5a360595daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.615296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1395/2780] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:18.624324 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.624624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.624898 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.631296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1386/2781] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:18.639305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.639606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.639870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.642930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:18.644235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.652098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1396/2782] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:18.656293 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.657942 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:18.659114 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:18.665228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472cf7a-7562-4e7a-82f3-483c80285035 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.667002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1387/2783] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:18.669821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.670551 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.670833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.670995 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.671104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.671834 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:57:18.672139 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.673769 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.679693 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1b156-5a62-454a-904d-a6c605823433 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.684148 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.684818 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.685093 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.685315 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1397/2784] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:57:18.685418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.686067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:57:18.686365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.687933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.689576 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.698986 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e3c53-ee92-4ac7-b1ec-ad1d8845fa91 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.699964 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1388/2785] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:57:18.703944 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.704202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.704674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.705091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.705356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.706068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.708013 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.714412 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae99af-36e0-4e75-9217-3ed9226d9346 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.719136 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.719773 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.720050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.720320 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.721043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.723045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.738812 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1398/2786] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:57:18.740241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.753060 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1389/2787] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:57:18.754101 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.799719 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d989-c75f-4417-a65d-312ca886ae29 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.813772 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f04f-7e98-42cd-9fdc-41db2ef49f80 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.818905 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.819612 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.819891 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.820171 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.820907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.822826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.845066 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1390/2788] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:57:18.849304 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.858696 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdf2e-e410-48e5-a04b-6a7738fc38a8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.860244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.860977 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.861256 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.861529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.862240 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.863386 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.864031 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.864316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.864484 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.864610 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.865331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.866894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.877254 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1391/2789] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:57:18.881465 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.889880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1399/2790] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:57:18.890757 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.891220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657ef4-a423-4ea6-87a7-b791a12fe992 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.895910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.896607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.896887 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.897160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.897929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.899551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.900394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aaa05-9a88-49d2-a766-475155d20778 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.905071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.905766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.906048 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.906321 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.907053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.908656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.909363 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1392/2791] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:57:18.913717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.919093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1400/2792] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:18.922775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.923043 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ae00e-4a2b-4166-8876-ad0450dec9db admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.927851 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.928754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.929032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.930292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] PATH_INFO: `/v3/projects/cff657524a924c11b622d825be7bc02b/users/889f0d6216ed47c982ee88e0ce21102e/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.932845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9d45-ec0b-40e4-b73e-47b61577e003 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.937900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:18.938556 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.938831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.939104 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.939831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.941502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.944645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff657524a924c11b622d825be7bc02b, user_id=889f0d6216ed47c982ee88e0ce21102e, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:18.947283 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ea32-7658-43f5-8d9d-69e0f2a450eb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:18.952200 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1401/2793] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:57:18.957431 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:18.962109 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1393/2794] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:18 2021] PUT /identity/v3/projects/cff657524a924c11b622d825be7bc02b/users/889f0d6216ed47c982ee88e0ce21102e/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:57:18.967609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fecc38-02f6-4626-a947-92b2056372f4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:18.972417 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:18.972737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:18.973017 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:18.999082 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] MFA Rules not processed for user `889f0d6216ed47c982ee88e0ce21102e`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:19.000195 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:19.022867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.023772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.024056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.024329 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] PATH_INFO: `/v3/projects/82c7f86e26764992be0ae296e86cfd40/users/0ef508e0848c45fabb4b5d4408d833a9/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.039009 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c7f86e26764992be0ae296e86cfd40, user_id=0ef508e0848c45fabb4b5d4408d833a9, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.041734 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e145d4-d10f-4d4c-8b68-627d01533dda admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.054810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1402/2795] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:18 2021] PUT /identity/v3/projects/82c7f86e26764992be0ae296e86cfd40/users/0ef508e0848c45fabb4b5d4408d833a9/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:19.064257 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1394/2796] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:19.065080 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.065367 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.065638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.069012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.079095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17931-251b-4784-a926-1850c0f214b2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.092853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] MFA Rules not processed for user `0ef508e0848c45fabb4b5d4408d833a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:19.094079 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:19.137316 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.137953 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.138226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.138491 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.139181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.141103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.168522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1403/2797] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:19 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:19.168833 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1395/2798] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:57:19 2021] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:57:19.169959 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.175390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.177346 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:19.180549 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739650ef-caa2-4ba0-9083-3a982292d73a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.232416 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad574-77ab-41f3-905d-50866e7c5509 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.235870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.236577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.236710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.236848 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.237121 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.237242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.237508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.237853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.237982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.240144 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.263244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1404/2799] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:57:19 2021] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:57:19.264288 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.273930 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80efb54-7d19-400a-9fdb-90c37772463c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.278631 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.279291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.279565 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.279832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.280605 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.282173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.291851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1405/2800] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:19.293284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.294854 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.295795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.304096 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1396/2801] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:19 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:57:19.304943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145883f-e4cf-4151-a1fa-2fce9adf64dc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.309445 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.310265 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.310523 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.310795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] PATH_INFO: `/v3/projects/d0e9be0f29e749cb8a958f287586c4d5/users/9c488e8f724c4655982e15126315edc1/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.328175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e9be0f29e749cb8a958f287586c4d5, user_id=9c488e8f724c4655982e15126315edc1, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.330940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.345936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1406/2802] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:19 2021] PUT /identity/v3/projects/d0e9be0f29e749cb8a958f287586c4d5/users/9c488e8f724c4655982e15126315edc1/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:57:19.350457 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.361229 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3388e-50cf-4fd2-b12a-2b8f99a8768c service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.424582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.426671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.426671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.426671 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.427228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.428862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255916-2a0c-493f-b7be-8b5466d0cd5d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.439034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1397/2803] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:57:19.443386 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.453526 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f384c6d-c333-426e-b85a-b37c52d377c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.458401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.459284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.459560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.459830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] PATH_INFO: `/v3/projects/d0e9be0f29e749cb8a958f287586c4d5/users/9c488e8f724c4655982e15126315edc1/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.462233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e9be0f29e749cb8a958f287586c4d5, user_id=9c488e8f724c4655982e15126315edc1, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.464793 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.475149 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1407/2804] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:57:19 2021] PUT /identity/v3/projects/d0e9be0f29e749cb8a958f287586c4d5/users/9c488e8f724c4655982e15126315edc1/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:19.537198 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.537433 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.537808 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.565183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] MFA Rules not processed for user `9c488e8f724c4655982e15126315edc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:19.566581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:19.636022 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1398/2805] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:19 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:19.647230 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:19.649226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:19.717388 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b2a-0544-4326-b259-3c53ac69fd2b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:19.721241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:19.721962 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:19.722333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:19.722673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:19.789603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:19.791347 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b49a98-5f97-4c05-8834-16613079a0b9 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:19.800346 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1408/2806] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:24.433609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:24.500355 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b30277-833c-4404-bd30-c1be5b8fda22 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:24.506165 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:24.507046 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:24.507329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:24.507602 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] PATH_INFO: `/v3/users/889f0d6216ed47c982ee88e0ce21102e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:24.508901 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] RBAC: Authorizing `identity:delete_user(user_id=889f0d6216ed47c982ee88e0ce21102e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:24.510826 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:24.564384 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889f0d6216ed47c982ee88e0ce21102e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:24.565058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889f0d6216ed47c982ee88e0ce21102e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:24.571741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889f0d6216ed47c982ee88e0ce21102e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:24.582943 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889f0d6216ed47c982ee88e0ce21102e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:24.593962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889f0d6216ed47c982ee88e0ce21102e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:24.600607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1399/2807] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:24 2021] DELETE /identity/v3/users/889f0d6216ed47c982ee88e0ce21102e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:24.605235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:24.605729 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:24.605827 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:24.623499 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:24.624760 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:24.686190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1409/2808] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:57:24.696655 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:24.698333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:24.760231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeedbd3-dd2d-4f9e-ae8d-62d538c8243b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:24.764862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:24.765515 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:24.765794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:24.766062 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:24.776955 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:24.778392 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:24.788815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1400/2809] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:25.071219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:25.073146 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:25.089636 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcce4f-e2c1-40b1-8a3f-6fb2ae368d28 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:25.094748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:25.095603 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:25.095881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:25.096155 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] PATH_INFO: `/v3/projects/cff657524a924c11b622d825be7bc02b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:25.097682 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff657524a924c11b622d825be7bc02b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:25.099458 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:25.153821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff657524a924c11b622d825be7bc02b', 'request_id': 'req-2845270a-486c-44d8-904c-9e88d3601225'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.159150 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff657524a924c11b622d825be7bc02b', 'request_id': 'req-2845270a-486c-44d8-904c-9e88d3601225'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.165485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff657524a924c11b622d825be7bc02b', 'request_id': 'req-2845270a-486c-44d8-904c-9e88d3601225'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.179790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] The token cache is being invalidate because project cff657524a924c11b622d825be7bc02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:25.180128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.183203 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.184821 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1410/2810] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:25 2021] DELETE /identity/v3/projects/cff657524a924c11b622d825be7bc02b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:25.188764 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:25.198437 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaabf5-51de-4344-b017-ff2020eaa309 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:25.255116 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:25.256183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:25.256420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:25.256740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] PATH_INFO: `/v3/users/9c488e8f724c4655982e15126315edc1` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:25.258147 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c488e8f724c4655982e15126315edc1)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:25.260080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:25.309539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c488e8f724c4655982e15126315edc1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.310289 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c488e8f724c4655982e15126315edc1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.317463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c488e8f724c4655982e15126315edc1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.329665 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c488e8f724c4655982e15126315edc1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.338654 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c488e8f724c4655982e15126315edc1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.345018 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1401/2811] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:25 2021] DELETE /identity/v3/users/9c488e8f724c4655982e15126315edc1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:25.619837 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:25.621420 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:25.635743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845270a-486c-44d8-904c-9e88d3601225 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:25.693831 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:25.694627 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:25.694900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:25.695171 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] PATH_INFO: `/v3/projects/d0e9be0f29e749cb8a958f287586c4d5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:25.696355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e9be0f29e749cb8a958f287586c4d5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:25.698305 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:25.745211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e9be0f29e749cb8a958f287586c4d5', 'request_id': 'req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.750748 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e9be0f29e749cb8a958f287586c4d5', 'request_id': 'req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.757632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e9be0f29e749cb8a958f287586c4d5', 'request_id': 'req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.774173 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] The token cache is being invalidate because project d0e9be0f29e749cb8a958f287586c4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:25.774462 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.775072 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-782f7d1d-64c4-492f-8578-5d9c72c9cbdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:25.776751 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1411/2812] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:25 2021] DELETE /identity/v3/projects/d0e9be0f29e749cb8a958f287586c4d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:57:27.390584 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:27.392236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:27.406336 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f9205-e59c-4769-8caa-afc9990d353c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:27.470825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:27.471707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:27.471985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:27.472252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] PATH_INFO: `/v3/users/0ef508e0848c45fabb4b5d4408d833a9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:27.473583 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef508e0848c45fabb4b5d4408d833a9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:27.475557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:27.528894 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef508e0848c45fabb4b5d4408d833a9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:27.529557 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef508e0848c45fabb4b5d4408d833a9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:27.536181 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef508e0848c45fabb4b5d4408d833a9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:27.548154 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef508e0848c45fabb4b5d4408d833a9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:27.559332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef508e0848c45fabb4b5d4408d833a9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:27.565451 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1402/2813] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:57:27 2021] DELETE /identity/v3/users/0ef508e0848c45fabb4b5d4408d833a9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:57:27.570161 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:27.570710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:27.570838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:27.589291 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:57:27.590515 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:27.655453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1412/2814] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:57:27.665530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:27.667095 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:27.727213 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef58f-3531-42fe-b3a3-d6c15fb2dd7f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:27.733781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:27.734658 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:27.734935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:27.735202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:27.747510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:27.749752 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:27.760765 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1403/2815] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:57:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:57:28.028326 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:57:28.029868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:57:28.043092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2dd2-5a0e-44a7-86d2-345914577778 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:57:28.048696 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:57:28.049568 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:57:28.049851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:57:28.050119 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] PATH_INFO: `/v3/projects/82c7f86e26764992be0ae296e86cfd40` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:57:28.051524 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c7f86e26764992be0ae296e86cfd40)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:57:28.053401 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:57:28.100530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c7f86e26764992be0ae296e86cfd40', 'request_id': 'req-7b11022f-d7b6-4957-84ec-134b90e0f446'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:28.106004 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c7f86e26764992be0ae296e86cfd40', 'request_id': 'req-7b11022f-d7b6-4957-84ec-134b90e0f446'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:28.112301 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c7f86e26764992be0ae296e86cfd40', 'request_id': 'req-7b11022f-d7b6-4957-84ec-134b90e0f446'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:28.126187 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] The token cache is being invalidate because project 82c7f86e26764992be0ae296e86cfd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:57:28.126480 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:28.127184 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:57:28.128880 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1413/2816] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:57:28 2021] DELETE /identity/v3/projects/82c7f86e26764992be0ae296e86cfd40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:58:36.297759 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:58:36.300423 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:58:36.378100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9e0f-ac29-4b2d-b951-53f55c4f9817 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:58:36.429365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:58:36.430253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:58:36.430862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:58:36.431228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:58:36.434331 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:58:36.521209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:58:36.522642 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:58:36.532997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1404/2817] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:58:36 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:36.822904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:36.824610 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:36.889028 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11022f-d7b6-4957-84ec-134b90e0f446 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:36.893476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:36.894133 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:36.894408 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:36.894678 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:36.896675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:36.968307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:36.969703 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:36.979327 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1414/2818] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:37.115793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:37.117235 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:37.188246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0117d-37a4-49ee-8477-415deb66a068 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:37.193988 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:37.194645 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:37.194912 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:37.195179 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:37.197104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:37.208769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:37.210525 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:37.221879 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1405/2819] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:40.182971 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.184467 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:40.197948 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6e60-b7ad-450b-ac86-96f74df683d1 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.203924 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.204900 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.205183 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.205454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] PATH_INFO: `/v3/users/5686da93293e439eaf999b67fc154b14` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.206698 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5686da93293e439eaf999b67fc154b14)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.208737 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.256859 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5686da93293e439eaf999b67fc154b14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.269118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5686da93293e439eaf999b67fc154b14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.278026 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5686da93293e439eaf999b67fc154b14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.284736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5686da93293e439eaf999b67fc154b14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.285362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e704e1ce-9f32-4a8b-9f43-76e73ee1d1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5686da93293e439eaf999b67fc154b14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.291492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1415/2820] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:40 2021] DELETE /identity/v3/users/5686da93293e439eaf999b67fc154b14 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:40.479577 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.490653 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106583b6-46d7-4a66-8268-d99cc4f01b77 service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.547332 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.548196 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.548509 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.548790 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] PATH_INFO: `/v3/projects/9264b7d2b1b4444f848035561e48c126` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.549976 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9264b7d2b1b4444f848035561e48c126)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.551881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.599190 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9264b7d2b1b4444f848035561e48c126', 'request_id': 'req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.608593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9264b7d2b1b4444f848035561e48c126', 'request_id': 'req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.614615 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9264b7d2b1b4444f848035561e48c126', 'request_id': 'req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.626499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] The token cache is being invalidate because project 9264b7d2b1b4444f848035561e48c126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:40.626781 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.627418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-df84ae79-e9d3-4f30-89f1-6e1b27942d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:40.629152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1406/2821] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:40 2021] DELETE /identity/v3/projects/9264b7d2b1b4444f848035561e48c126 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:40.637190 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.637516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.637766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.656254 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:40.657674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:40.718972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1416/2822] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:40.727156 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.727447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.727737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.747292 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:40.748541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:40.757542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1407/2823] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:40.762199 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.771674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e3330-5048-4049-8fc7-550636d777a9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.776813 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.777468 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.777753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.778024 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.778779 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:59:40.779082 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.780704 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.797033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1417/2824] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:59:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:59:40.798484 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.807845 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1092c-b069-4ef9-878e-33e99d7476e4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.812717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.813369 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.813646 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.813913 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.814616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.816541 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.842494 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1408/2825] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:40 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:40.846660 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.856755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e8d07-7471-4acd-bff5-b983c1fdd7d5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.911403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.912071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.912356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.912663 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.913385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.915372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.944895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1418/2826] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:40 2021] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:40.950251 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.961860 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1c3-2b73-4678-b09a-3c49b4d48237 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:40.967231 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:40.967898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:40.968178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:40.968420 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:40.969220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:40.970825 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:40.981614 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1409/2827] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:40.985802 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:40.996360 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd032-e7ad-42fd-a8bd-a49df1997292 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.001564 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.002225 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.002530 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.002805 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.003531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.005165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd005e-be89-43f4-aa7f-b61b787d159e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.015784 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1419/2828] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:41.020134 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.030623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f380b-465d-47ca-b84b-7d65b1d98aea admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.035593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.036510 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.036793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.037067 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] PATH_INFO: `/v3/projects/b35706eef74a4c3da9ed623d4aa96e11/users/e293a894d1704037a19910e5eebfc791/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.051266 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35706eef74a4c3da9ed623d4aa96e11, user_id=e293a894d1704037a19910e5eebfc791, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.053958 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.067819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1410/2829] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:41 2021] PUT /identity/v3/projects/b35706eef74a4c3da9ed623d4aa96e11/users/e293a894d1704037a19910e5eebfc791/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:41.079845 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.080219 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.080607 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.114598 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] MFA Rules not processed for user `e293a894d1704037a19910e5eebfc791`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:41.115795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:41.180968 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1420/2830] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:41 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:59:41.185707 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.253365 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211db5-443d-42d9-bdf6-7ba4fe48901d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.259328 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.260008 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.260290 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.260598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.261279 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.263185 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.294516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1411/2831] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:41 2021] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:41.299476 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.310694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955fdf-d3d9-4c33-bf31-bc2a1b4a29a8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.370180 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.370841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.371128 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.371402 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.372110 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.374068 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.397566 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1421/2832] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:41 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:41.402104 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.414050 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c8f6d-9bc6-4a68-88fc-c8691a888ea4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.421761 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.422685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.423025 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.423390 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.424552 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.426662 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.440362 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1412/2833] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:41.444709 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.454863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffffd15-f4f7-4af3-9659-de7ec8740f20 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.459685 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.460609 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.460889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.461163 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] PATH_INFO: `/v3/projects/21defbad22a94dd48803dcdbacc31376/users/e7d34f0418b344e08dd329f3595ef771/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.477954 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21defbad22a94dd48803dcdbacc31376, user_id=e7d34f0418b344e08dd329f3595ef771, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.480639 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.495516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1422/2834] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:41 2021] PUT /identity/v3/projects/21defbad22a94dd48803dcdbacc31376/users/e7d34f0418b344e08dd329f3595ef771/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:41.500230 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.516256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f5168-afd5-45c5-aaaf-371cf773e65a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.576742 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.577436 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.577714 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.577985 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.578754 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.580360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634acfa3-6bdc-438f-bdc5-3d4799a9c8d8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.591020 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1413/2835] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:41.595673 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.606766 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be97a4b-d253-4c5e-b798-778e1e9591d7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.612699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.613606 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.613879 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.614154 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] PATH_INFO: `/v3/projects/21defbad22a94dd48803dcdbacc31376/users/e7d34f0418b344e08dd329f3595ef771/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.616344 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21defbad22a94dd48803dcdbacc31376, user_id=e7d34f0418b344e08dd329f3595ef771, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.619109 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.636085 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1423/2836] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:41 2021] PUT /identity/v3/projects/21defbad22a94dd48803dcdbacc31376/users/e7d34f0418b344e08dd329f3595ef771/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:41.648477 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.648799 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.649074 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.677582 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] MFA Rules not processed for user `e7d34f0418b344e08dd329f3595ef771`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:41.678786 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:41.746929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1414/2837] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:41 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:41.761217 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.763463 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:41.856259 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684ec99-f19f-424c-8e9f-2d9d4d71e0c4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.860471 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.861114 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.861390 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.861655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:41.871038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:41.872477 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:41.881863 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1424/2838] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:41 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:41.926864 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:41.928349 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:41.941121 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e7f13-6937-4208-8b01-e32447bcb2c5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:41.945261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:41.945920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:41.946201 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:41.946474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:42.002518 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:42.003965 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7af1a-20ef-449f-82e2-79f01bb57a30 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:42.013750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1415/2839] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:41 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:45.341296 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:45.406449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbfce4-7824-4f2a-b395-a21f0bee9241 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:45.411226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:45.412098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:45.412377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:45.412681 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] PATH_INFO: `/v3/users/e293a894d1704037a19910e5eebfc791` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:45.413870 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e293a894d1704037a19910e5eebfc791)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:45.415830 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:45.471460 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e293a894d1704037a19910e5eebfc791'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:45.484869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e293a894d1704037a19910e5eebfc791'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:45.494032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e293a894d1704037a19910e5eebfc791'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:45.501403 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e293a894d1704037a19910e5eebfc791'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:45.502038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e293a894d1704037a19910e5eebfc791'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:45.507718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1425/2840] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:45 2021] DELETE /identity/v3/users/e293a894d1704037a19910e5eebfc791 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:45.512489 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:45.512997 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:45.513112 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:45.531079 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:45.532361 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:45.595122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1416/2841] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:45.605736 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:45.607446 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:45.666807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37fcb-cf30-4841-bffe-f014ca64fcfc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:45.671242 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:45.671888 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:45.672174 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:45.672464 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:45.682495 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:45.683929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:45.693507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1426/2842] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:45.976529 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:45.978073 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:45.990216 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb668-6742-4cb9-9e06-59ce8c628fc5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:45.995705 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:45.996623 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:45.996907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:45.997180 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] PATH_INFO: `/v3/projects/b35706eef74a4c3da9ed623d4aa96e11` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:45.998481 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35706eef74a4c3da9ed623d4aa96e11)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.000356 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:46.052012 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35706eef74a4c3da9ed623d4aa96e11', 'request_id': 'req-bb27784f-2b41-45ca-81ff-c076efbe7cae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.060191 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35706eef74a4c3da9ed623d4aa96e11', 'request_id': 'req-bb27784f-2b41-45ca-81ff-c076efbe7cae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.066054 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35706eef74a4c3da9ed623d4aa96e11', 'request_id': 'req-bb27784f-2b41-45ca-81ff-c076efbe7cae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.076947 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] The token cache is being invalidate because project b35706eef74a4c3da9ed623d4aa96e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:46.077232 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.077865 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.079425 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1417/2843] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:45 2021] DELETE /identity/v3/projects/b35706eef74a4c3da9ed623d4aa96e11 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:46.083516 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:46.094587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c9c9a-218e-49a3-933a-88e135dd533d service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:46.155518 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:46.156394 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.156710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.156984 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] PATH_INFO: `/v3/users/e7d34f0418b344e08dd329f3595ef771` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.158213 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d34f0418b344e08dd329f3595ef771)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.160134 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:46.206281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d34f0418b344e08dd329f3595ef771'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.219281 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d34f0418b344e08dd329f3595ef771'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.229795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d34f0418b344e08dd329f3595ef771'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.236531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d34f0418b344e08dd329f3595ef771'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.237252 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-8fb54b01-f476-4b68-99c8-cfee932ad494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d34f0418b344e08dd329f3595ef771'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.243153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1427/2844] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:46 2021] DELETE /identity/v3/users/e7d34f0418b344e08dd329f3595ef771 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:46.520967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:46.522542 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:46.542238 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27784f-2b41-45ca-81ff-c076efbe7cae admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:46.599343 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:46.600152 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.600455 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.600737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] PATH_INFO: `/v3/projects/21defbad22a94dd48803dcdbacc31376` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.601970 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21defbad22a94dd48803dcdbacc31376)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.603992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:46.650770 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21defbad22a94dd48803dcdbacc31376', 'request_id': 'req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.658890 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21defbad22a94dd48803dcdbacc31376', 'request_id': 'req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.664157 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21defbad22a94dd48803dcdbacc31376', 'request_id': 'req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.674882 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] The token cache is being invalidate because project 21defbad22a94dd48803dcdbacc31376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:46.675177 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.675801 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5dfe324c-7e69-47dc-ac20-c5a4d3bcc541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:46.677370 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1418/2845] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:46 2021] DELETE /identity/v3/projects/21defbad22a94dd48803dcdbacc31376 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:46.685131 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.685621 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.685735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.704233 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:46.705456 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:46.765419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1428/2846] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:46.773305 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.773597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.773875 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.792883 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:46.794125 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:46.803303 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1419/2847] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:46.807674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:46.817922 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563fe4f-e603-41c9-8fd7-0b9a5173fbfd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:46.823637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:46.824304 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.824618 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.824882 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.825616 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:59:46.825919 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.827492 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:46.840789 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1429/2848] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:59:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:59:46.845811 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:46.860407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb3e5-d83e-4f1d-8402-cf4a09ad4a6e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:46.868240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:46.869131 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.869569 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.869847 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.870554 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.872464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:46.899546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1420/2849] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:46 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:46.903810 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:46.914105 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723035e-0145-49f5-9a60-9eb144b91307 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:46.977081 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:46.977750 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:46.978032 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:46.978677 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:46.980165 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:46.982130 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.009502 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1430/2850] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:46 2021] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:47.014407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.030961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44db65-592c-4eea-8a72-e5265a502d9e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.038051 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.039006 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.039397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.039726 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.040831 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.042476 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.053406 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1421/2851] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:47.057637 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.068038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e21ef-27db-49c1-9bff-968492128119 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.074036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.074695 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.074972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.075244 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.075990 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.077617 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea606eab-6709-48f6-b9cf-c819cf8ff04f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.088017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1431/2852] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:47.092762 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.106464 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fce22-a10c-41c1-8b5e-3d4ed6fe8807 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.112493 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.113327 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.113607 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.113888 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] PATH_INFO: `/v3/projects/1d9f1e94238342e696ba40f79c2c99dd/users/44f7dea36f23403f9843d42a9287c73f/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.128954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9f1e94238342e696ba40f79c2c99dd, user_id=44f7dea36f23403f9843d42a9287c73f, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.131630 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.147242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1422/2853] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:47 2021] PUT /identity/v3/projects/1d9f1e94238342e696ba40f79c2c99dd/users/44f7dea36f23403f9843d42a9287c73f/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:47.158862 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.159141 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.159409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.197159 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] MFA Rules not processed for user `44f7dea36f23403f9843d42a9287c73f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:47.198333 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:47.279257 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1432/2854] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:47.284866 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.350741 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a2ac4-47b9-4d99-a234-2079897c8277 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.356296 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.356972 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.357270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.357537 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.358271 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.360168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.389780 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1423/2855] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:47.395644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.407113 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4dffa-ce1b-456c-b070-94f4b13bc896 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.471683 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.472356 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.472666 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.472942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.473655 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.475591 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.498193 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1433/2856] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:47.503925 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.514443 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd2e46-b97e-4368-9f44-bec598b607c9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.519881 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.520570 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.520853 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.521123 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.521858 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.523446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.534063 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1424/2857] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:59:47.538185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.548362 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb832-0104-49b6-8b72-60e43e024ba3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.553166 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.553815 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.554091 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.554366 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.555098 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.556982 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568d9b7-d951-4a6b-9827-94042ea683e9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.566913 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1434/2858] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:47.571036 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.581103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f7a3c-b3e9-4359-8e38-330e6f90afc1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.586172 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.587490 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.587823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.588080 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] PATH_INFO: `/v3/projects/edad295ff4cc426a84ca9dd0d56fe5ab/users/144e7c6cf0874495a7370ca88325dd06/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.603597 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edad295ff4cc426a84ca9dd0d56fe5ab, user_id=144e7c6cf0874495a7370ca88325dd06, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.606262 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.620996 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1425/2859] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:47 2021] PUT /identity/v3/projects/edad295ff4cc426a84ca9dd0d56fe5ab/users/144e7c6cf0874495a7370ca88325dd06/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:47.631237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.631586 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.631889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.659411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] MFA Rules not processed for user `144e7c6cf0874495a7370ca88325dd06`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:47.660595 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:47.722739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1435/2860] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:47.727360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.796183 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844381f7-8fd9-4b17-a4d5-e0ac12fad74b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.801979 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.802643 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.802916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.803182 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.803880 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.805816 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.834473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1426/2861] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:47.839282 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.850697 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316c15-a5de-4ead-a7dc-9a679f7d2ed9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.911336 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.912066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.912185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.912545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.913246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.915355 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.936661 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1436/2862] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:47 2021] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:47.940929 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.951360 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e638-844e-405c-8328-ffb64c6a0366 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.956546 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.957202 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.957478 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.957745 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:47.958466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:47.960040 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:47.971057 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1427/2863] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:47.975624 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:47.986613 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c27a9-91bb-439e-8402-6a9b1aa4c376 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:47.992587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:47.993487 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:47.993818 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:47.994156 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] PATH_INFO: `/v3/projects/c55fd888a8b845a19424130868a41f1e/users/d04c230b06664393912750e49a031ba5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:48.010185 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55fd888a8b845a19424130868a41f1e, user_id=d04c230b06664393912750e49a031ba5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:48.012914 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:48.029209 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1437/2864] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:47 2021] PUT /identity/v3/projects/c55fd888a8b845a19424130868a41f1e/users/d04c230b06664393912750e49a031ba5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:48.033463 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:48.043941 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900142b-1df7-4bd8-90ed-a3185a3614bb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:48.110800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:48.111479 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:48.111769 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:48.112048 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:48.112821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:48.114428 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb556-2a68-4052-ad78-8d71c60fcc9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:48.124852 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1428/2865] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:48 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:59:48.129833 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:48.146772 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07276e13-0228-435d-b97a-ebc8ae42b7a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:48.153749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:48.154629 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:48.154909 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:48.155178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] PATH_INFO: `/v3/projects/c55fd888a8b845a19424130868a41f1e/users/d04c230b06664393912750e49a031ba5/roles/5f760d89f7794814b25f104c56fc0fcb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:48.157474 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55fd888a8b845a19424130868a41f1e, user_id=d04c230b06664393912750e49a031ba5, role_id=5f760d89f7794814b25f104c56fc0fcb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:48.160145 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:48.171343 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1438/2866] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:48 2021] PUT /identity/v3/projects/c55fd888a8b845a19424130868a41f1e/users/d04c230b06664393912750e49a031ba5/roles/5f760d89f7794814b25f104c56fc0fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:48.182661 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:48.182945 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:48.183219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:48.210159 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] MFA Rules not processed for user `d04c230b06664393912750e49a031ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:48.211720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:48.294308 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1429/2867] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:48 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:48.304755 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:48.307022 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:48.375365 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc42f-539c-4712-9a4f-d66f42e4e040 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:48.381569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:48.382522 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:48.382869 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:48.383208 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:48.398529 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:48.400642 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:48.410228 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1439/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:48 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:48.920242 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:48.922058 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:48.935709 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28095b9-2c1e-4424-b8eb-3b1dc59580ac None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:48.940256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:48.940944 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:48.941219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:48.941485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:49.001915 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:49.003375 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:49.016337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1430/2869] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:48 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:53.040039 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:53.049593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc2cb-886d-4b49-9510-46a571fdd7ee service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:53.053450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:53.054089 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:53.054369 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:53.054644 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:53.113997 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:53.115409 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb09b7d-bf04-4632-ab4c-92597f1841ab service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:53.124963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1440/2870] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:53 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:55.205269 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:55.266933 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900324-cf7b-4dd1-8636-d8ac97be9e66 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:55.271992 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:55.272900 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:55.273141 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:55.273446 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] PATH_INFO: `/v3/users/44f7dea36f23403f9843d42a9287c73f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:55.274664 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f7dea36f23403f9843d42a9287c73f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:55.276616 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:55.332310 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f7dea36f23403f9843d42a9287c73f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.332994 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f7dea36f23403f9843d42a9287c73f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.340418 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f7dea36f23403f9843d42a9287c73f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.353740 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f7dea36f23403f9843d42a9287c73f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.361470 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f7dea36f23403f9843d42a9287c73f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.367297 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1431/2871] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:55 2021] DELETE /identity/v3/users/44f7dea36f23403f9843d42a9287c73f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:55.372511 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:55.373033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:55.373033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:55.391739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:55.392911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:55.459731 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1441/2872] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:55.471598 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:55.473097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:55.545301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaae0f-bcb3-4496-8c51-e782b6fc11f3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:55.550100 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:55.550756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:55.551034 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:55.551306 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:55.569246 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:55.570641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:55.581892 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1432/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:59:55.860531 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:55.861949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:55.873838 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb295a-94b0-432a-a911-b3b6644009a4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:55.879509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:55.880385 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:55.880699 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:55.880972 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] PATH_INFO: `/v3/projects/1d9f1e94238342e696ba40f79c2c99dd` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:55.882275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9f1e94238342e696ba40f79c2c99dd)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:55.884179 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:55.941067 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9f1e94238342e696ba40f79c2c99dd', 'request_id': 'req-277f8307-d32a-44a5-84cc-540831a9d2ef'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.946643 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9f1e94238342e696ba40f79c2c99dd', 'request_id': 'req-277f8307-d32a-44a5-84cc-540831a9d2ef'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.952881 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9f1e94238342e696ba40f79c2c99dd', 'request_id': 'req-277f8307-d32a-44a5-84cc-540831a9d2ef'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.968449 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] The token cache is being invalidate because project 1d9f1e94238342e696ba40f79c2c99dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:55.968739 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.969400 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:55.970953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1442/2874] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:55 2021] DELETE /identity/v3/projects/1d9f1e94238342e696ba40f79c2c99dd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:55.975168 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:55.985620 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562700cc-03a0-4588-8209-a993e74b694e service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:56.044902 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:56.045834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:56.046103 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:56.046376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] PATH_INFO: `/v3/users/144e7c6cf0874495a7370ca88325dd06` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:56.047609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144e7c6cf0874495a7370ca88325dd06)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:56.049578 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:56.104441 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144e7c6cf0874495a7370ca88325dd06'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.105485 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144e7c6cf0874495a7370ca88325dd06'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.113482 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144e7c6cf0874495a7370ca88325dd06'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.126426 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144e7c6cf0874495a7370ca88325dd06'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.135333 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144e7c6cf0874495a7370ca88325dd06'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.141374 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1433/2875] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:55 2021] DELETE /identity/v3/users/144e7c6cf0874495a7370ca88325dd06 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:56.434215 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:56.435936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:56.451883 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f8307-d32a-44a5-84cc-540831a9d2ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:56.512017 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:56.513056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:56.513335 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:56.513672 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] PATH_INFO: `/v3/projects/edad295ff4cc426a84ca9dd0d56fe5ab` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:56.515674 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=edad295ff4cc426a84ca9dd0d56fe5ab)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:56.518557 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:56.572832 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edad295ff4cc426a84ca9dd0d56fe5ab', 'request_id': 'req-7480547f-9dd7-461a-a824-157a0107d6ac'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.578849 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edad295ff4cc426a84ca9dd0d56fe5ab', 'request_id': 'req-7480547f-9dd7-461a-a824-157a0107d6ac'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.585453 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edad295ff4cc426a84ca9dd0d56fe5ab', 'request_id': 'req-7480547f-9dd7-461a-a824-157a0107d6ac'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.605496 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] The token cache is being invalidate because project edad295ff4cc426a84ca9dd0d56fe5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:56.605868 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.607036 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.608573 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1443/2876] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:56 2021] DELETE /identity/v3/projects/edad295ff4cc426a84ca9dd0d56fe5ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:56.612717 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:56.614228 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:56.627110 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6189-f3a5-4675-a842-2cd7ada85bc1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:56.683625 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:56.684531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:56.684848 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:56.685132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] PATH_INFO: `/v3/users/d04c230b06664393912750e49a031ba5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:56.686447 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04c230b06664393912750e49a031ba5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:56.688366 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:56.736898 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04c230b06664393912750e49a031ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.737550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04c230b06664393912750e49a031ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.744385 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04c230b06664393912750e49a031ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.757035 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04c230b06664393912750e49a031ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.765809 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0807bec0-90f5-43f8-bd0b-fa6d44035533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04c230b06664393912750e49a031ba5'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:56.772105 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1434/2877] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 16:59:56 2021] DELETE /identity/v3/users/d04c230b06664393912750e49a031ba5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:57.045509 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.047151 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:57.061545 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480547f-9dd7-461a-a824-157a0107d6ac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.120633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.121656 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.121942 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.122211 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] PATH_INFO: `/v3/projects/c55fd888a8b845a19424130868a41f1e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.123561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55fd888a8b845a19424130868a41f1e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.125579 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.185659 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55fd888a8b845a19424130868a41f1e', 'request_id': 'req-700bf978-6591-4045-95db-db4c8589f858'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:57.192533 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55fd888a8b845a19424130868a41f1e', 'request_id': 'req-700bf978-6591-4045-95db-db4c8589f858'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:57.198847 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55fd888a8b845a19424130868a41f1e', 'request_id': 'req-700bf978-6591-4045-95db-db4c8589f858'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:57.214905 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] The token cache is being invalidate because project c55fd888a8b845a19424130868a41f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:59:57.215195 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:57.215851 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-700bf978-6591-4045-95db-db4c8589f858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:59:57.218112 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1444/2878] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 16:59:57 2021] DELETE /identity/v3/projects/c55fd888a8b845a19424130868a41f1e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:57.224989 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.225276 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.225551 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.249220 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:57.250466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:57.319641 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1435/2879] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:57.328407 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.328724 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.329000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.348251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:57.349600 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:57.358234 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1445/2880] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:57.362521 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.372685 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcf9c4-eeac-45dd-a523-f45afdff7626 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.378389 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.379064 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.379341 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.379606 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.380344 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:59:57.380681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.382312 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.393967 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1436/2881] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 16:59:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:59:57.398328 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.407969 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e0d6-b436-4b80-911f-1a495cb70a7d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.413241 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.413895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.414178 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.414454 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.415255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.417137 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.443749 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1446/2882] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 16:59:57 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:57.447946 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.458032 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68deb-fb4a-4e20-8eec-dffd59aac140 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.527026 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.527687 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.527962 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.528227 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.528956 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.530950 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.555337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1437/2883] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 16:59:57 2021] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:59:57.559867 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.570653 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318b7-d664-4d46-881c-5250545eda66 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.575280 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.575949 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.576756 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.577038 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.577785 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.579379 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.590238 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1447/2884] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:59:57.594812 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.604720 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f78fe-5430-49eb-ac8d-291cb203b00e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.609700 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.610538 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.610821 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.611084 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.611954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.613688 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68483e2-f418-4e4d-bfed-0f2ad845582c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.627286 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1438/2885] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 16:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:59:57.636662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.649506 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966921a-6ef1-4f35-b91d-f305156c464d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.657567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.658934 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.659297 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.659657 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] PATH_INFO: `/v3/projects/801365f8105943faa6648f9932104abe/users/735d1757d1664e75948dc5dc18eb1a8e/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.680300 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801365f8105943faa6648f9932104abe, user_id=735d1757d1664e75948dc5dc18eb1a8e, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.683143 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.699011 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1448/2886] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 16:59:57 2021] PUT /identity/v3/projects/801365f8105943faa6648f9932104abe/users/735d1757d1664e75948dc5dc18eb1a8e/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:59:57.715460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.715750 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.716016 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.743928 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] MFA Rules not processed for user `735d1757d1664e75948dc5dc18eb1a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:59:57.745167 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:57.806795 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1439/2887] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 16:59:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:59:57.820411 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:59:57.822398 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:59:57.878693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491a36-61fe-4629-b6fd-7809998b45e3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:59:57.883050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:59:57.883684 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:59:57.883963 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:59:57.884235 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:59:57.892895 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:59:57.894319 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b5d68-e732-47c3-8307-3318292390d6 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:59:57.903050 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1449/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 16:59:57 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:00:00.951640 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:01.021135 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ee6e-4351-4ed2-a47d-9c2fcd994c65 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:01.026595 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:01.027466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.027737 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.028027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] PATH_INFO: `/v3/users/735d1757d1664e75948dc5dc18eb1a8e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.029302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=735d1757d1664e75948dc5dc18eb1a8e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:01.031466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:01.089364 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735d1757d1664e75948dc5dc18eb1a8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.090024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735d1757d1664e75948dc5dc18eb1a8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.096798 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735d1757d1664e75948dc5dc18eb1a8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.108215 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735d1757d1664e75948dc5dc18eb1a8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.118042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735d1757d1664e75948dc5dc18eb1a8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.124237 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1440/2889] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 17:00:00 2021] DELETE /identity/v3/users/735d1757d1664e75948dc5dc18eb1a8e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:00:01.130059 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.130521 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.130632 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.148035 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:01.149263 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:01.208307 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1450/2890] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:01.218916 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:01.220768 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:01.293388 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f871-e6a5-4b23-835d-c832bd342cbd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:01.297756 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:01.298407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.298692 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.298966 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.308581 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:01.310028 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805177-7019-42af-af2c-caa9da345c92 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:01.321910 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1441/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:00:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:00:01.611853 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:01.613973 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:01.634594 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b99fe5-f731-4080-aeff-ae3b6a367c8b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:01.642558 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:01.643422 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.643747 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.644255 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] PATH_INFO: `/v3/projects/801365f8105943faa6648f9932104abe` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.646175 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=801365f8105943faa6648f9932104abe)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:01.648638 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:01.709771 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801365f8105943faa6648f9932104abe', 'request_id': 'req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.718780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801365f8105943faa6648f9932104abe', 'request_id': 'req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.728378 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801365f8105943faa6648f9932104abe', 'request_id': 'req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.746780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] The token cache is being invalidate because project 801365f8105943faa6648f9932104abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 17:00:01.747044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.747764 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d4aaf92a-b09c-4d73-aa0e-fa2d471d40eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:01.750093 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1451/2892] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 17:00:01 2021] DELETE /identity/v3/projects/801365f8105943faa6648f9932104abe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:00:01.756907 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.757162 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.757517 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.782002 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:01.783208 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:01.863774 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1442/2893] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:01.873237 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.873527 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.873807 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.897710 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:01.898927 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:01.910841 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1452/2894] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:01.915301 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:01.926268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37861b09-3fd3-4619-9f8c-f395b68b1da0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:01.932249 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:01.932959 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.933268 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.933547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.934284 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 17:00:01.934590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:01.936236 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:01.949339 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1443/2895] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 17:00:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 17:00:01.954929 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:01.970417 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919935b-467b-42b9-98bd-2892f4ae4a67 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:01.978192 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:01.979275 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:01.979514 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:01.979889 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:01.981066 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:01.984142 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.022056 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1453/2896] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 17:00:01 2021] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 17:00:02.028407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:02.043256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b019-de71-4bd3-9322-7a3bf49f18cb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:02.117309 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:02.118239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.118544 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.119098 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.119815 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:02.121968 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.150508 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1444/2897] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 17:00:02 2021] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 17:00:02.156890 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:02.169535 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41d21-2c6f-4809-9ab0-980821f98401 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:02.178122 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:02.179158 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.179628 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.180027 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.181278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:02.183675 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.196940 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1454/2898] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 17:00:02 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 17:00:02.203256 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:02.218878 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc742-8077-4634-b9a2-ff11343d9d90 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:02.225302 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:02.225981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.226261 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.226530 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.227270 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:02.228920 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ca8a-3a06-4969-ae64-d9500dc475e3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.240681 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1445/2899] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 17:00:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 17:00:02.245943 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:02.258186 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73144c26-84cb-45f2-88f7-8a4d99cd4951 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:02.265071 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:02.266261 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.266640 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.266911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] PATH_INFO: `/v3/projects/20a9707b7d384ba3a9995c3ec32d87e0/users/427778c4e653486093bb33f3ac59b2d2/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.287053 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a9707b7d384ba3a9995c3ec32d87e0, user_id=427778c4e653486093bb33f3ac59b2d2, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:02.289773 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.304976 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1455/2900] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 17:00:02 2021] PUT /identity/v3/projects/20a9707b7d384ba3a9995c3ec32d87e0/users/427778c4e653486093bb33f3ac59b2d2/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:00:02.316222 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.316545 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.316823 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.346240 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] MFA Rules not processed for user `427778c4e653486093bb33f3ac59b2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:02.348041 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:02.420862 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1446/2901] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:02 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:02.434246 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:02.436795 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:02.506796 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae37c-f35e-484c-b44e-e39962659c1c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:02.511552 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3403d8ed438642c0a1a7fddce5762087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:02.512205 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:02.512485 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:02.512787 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:02.522127 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:02.523561 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7f4aa-0d19-4c01-8337-7aff98350f34 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:02.533377 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1456/2902] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:00:02 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:00:35.851660 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:35.922453 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59196f-0745-4e63-9c52-b6148c23cad3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:35.927822 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:35.928758 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:35.929045 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:35.929321 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] PATH_INFO: `/v3/users/427778c4e653486093bb33f3ac59b2d2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:35.930539 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427778c4e653486093bb33f3ac59b2d2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:35.932486 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:35.982345 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427778c4e653486093bb33f3ac59b2d2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:35.982982 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427778c4e653486093bb33f3ac59b2d2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:35.990600 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427778c4e653486093bb33f3ac59b2d2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.002547 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427778c4e653486093bb33f3ac59b2d2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.010593 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427778c4e653486093bb33f3ac59b2d2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.016981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1447/2903] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 17:00:35 2021] DELETE /identity/v3/users/427778c4e653486093bb33f3ac59b2d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:00:36.022278 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.022790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.022911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.040542 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:36.041745 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:36.106226 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1457/2904] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:36.117777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.119387 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:36.177473 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d66087-74cc-4c48-a836-966fcca13bf6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.181672 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.182337 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.182590 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.182844 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.192466 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.193908 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0580-ae28-4119-9fbc-19ea79f9e662 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.203329 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1448/2905] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:00:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:00:36.474512 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.476092 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:36.489253 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a74ca-c77f-4494-bade-2feb3e660d9a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.494569 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.495450 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.495790 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.496058 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] PATH_INFO: `/v3/projects/20a9707b7d384ba3a9995c3ec32d87e0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.497528 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a9707b7d384ba3a9995c3ec32d87e0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.499554 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.552181 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a9707b7d384ba3a9995c3ec32d87e0', 'request_id': 'req-52bc6eaa-d340-4319-9ebe-54e5e8c79859'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.557645 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a9707b7d384ba3a9995c3ec32d87e0', 'request_id': 'req-52bc6eaa-d340-4319-9ebe-54e5e8c79859'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.563878 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a9707b7d384ba3a9995c3ec32d87e0', 'request_id': 'req-52bc6eaa-d340-4319-9ebe-54e5e8c79859'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.578298 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] The token cache is being invalidate because project 20a9707b7d384ba3a9995c3ec32d87e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 17:00:36.578560 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.579214 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-52bc6eaa-d340-4319-9ebe-54e5e8c79859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:00:36.580842 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1458/2906] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 17:00:36 2021] DELETE /identity/v3/projects/20a9707b7d384ba3a9995c3ec32d87e0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 17:00:36.587427 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.587710 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.587981 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.605969 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:36.607282 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:36.668108 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1449/2907] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:36.723317 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.723641 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.723936 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.743437 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:36.744693 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:36.753593 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1459/2908] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:36.758178 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.768404 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6d6b7-aab8-4112-875f-cb0ba6398ee6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.773893 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.774550 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.774828 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.775097 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.775834 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 17:00:36.776139 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.777763 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.789876 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1450/2909] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Dec 15 17:00:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 17:00:36.794272 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.803887 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff74c2-2714-4d6a-b483-6823fb845a55 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.809694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.810354 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.810633 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.810911 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.811646 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.813587 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.842567 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1460/2910] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Dec 15 17:00:36 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 17:00:36.847000 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.857430 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582086-9f35-4302-a33b-4da030445112 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.915239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.915935 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.916221 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.916531 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.917252 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.919239 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.939024 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1451/2911] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Dec 15 17:00:36 2021] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 17:00:36.945002 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.959372 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9800-f112-4352-987d-c1271a3b3d3f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:36.965322 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:36.966015 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:36.966286 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:36.966555 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:36.967292 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:36.968916 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:36.979780 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1461/2912] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 17:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 17:00:36.983680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:36.994514 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191ce3-b044-4390-8fa5-d07eb09b118e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:37.000253 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:37.000954 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:37.001226 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:37.001492 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:37.002403 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:37.003961 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912b3c8-1dfc-4fb9-b408-0fe576df7124 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:37.015027 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1452/2913] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Dec 15 17:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 17:00:37.019507 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:37.030126 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994513e-a85b-428a-8a62-086c6c1b8c30 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:37.035236 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:37.036118 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:37.036399 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:37.036817 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] PATH_INFO: `/v3/projects/ef3b5f20e0d940108929dde87a65a85a/users/de651de7c2834237954edf5c65163274/roles/2cf8ebee4de04d798d9be9a723dbd015` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:37.052726 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3b5f20e0d940108929dde87a65a85a, user_id=de651de7c2834237954edf5c65163274, role_id=2cf8ebee4de04d798d9be9a723dbd015)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:37.055448 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:37.072033 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1462/2914] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Dec 15 17:00:37 2021] PUT /identity/v3/projects/ef3b5f20e0d940108929dde87a65a85a/users/de651de7c2834237954edf5c65163274/roles/2cf8ebee4de04d798d9be9a723dbd015 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:00:37.083160 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:37.083499 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:37.083776 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:37.113460 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] MFA Rules not processed for user `de651de7c2834237954edf5c65163274`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:00:37.114676 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:37.183800 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1453/2915] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:00:37 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 17:00:37.194419 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:00:37.196694 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:00:37.254012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68005c96-a5a9-4fb1-bddf-0bf0b57e7c3e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:00:37.258045 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f4ed434ad4685a93229ce1b6aef3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:00:37.258735 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:00:37.259012 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:00:37.259284 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:00:37.268743 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:00:37.270204 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155be4e-0157-46b8-bc67-986c3cc1cc71 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:00:37.279250 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1463/2916] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:00:37 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:01:14.637209 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:01:14.716192 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9c2d-db10-4093-b5d8-16601c3726b9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:01:14.722873 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:01:14.723868 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:01:14.723991 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:01:14.724219 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] PATH_INFO: `/v3/users/de651de7c2834237954edf5c65163274` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:01:14.726038 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] RBAC: Authorizing `identity:delete_user(user_id=de651de7c2834237954edf5c65163274)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:01:14.728819 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:01:14.782793 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de651de7c2834237954edf5c65163274'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:14.783777 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de651de7c2834237954edf5c65163274'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:14.794516 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de651de7c2834237954edf5c65163274'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:14.807122 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de651de7c2834237954edf5c65163274'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:14.815609 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de651de7c2834237954edf5c65163274'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:14.821536 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1454/2917] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Dec 15 17:01:14 2021] DELETE /identity/v3/users/de651de7c2834237954edf5c65163274 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 17:01:14.826299 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:01:14.826904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:01:14.826904 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:01:14.844957 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] MFA Rules not processed for user `22207ac88e304d2bb4d51c7880d43bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 17:01:14.846153 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:01:14.909000 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1464/2918] 10.222.0.30 () {58 vars in 957 bytes} [Wed Dec 15 17:01:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 17:01:14.920794 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:01:14.923205 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:01:14.988376 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694629b8-7945-49a8-bd27-a06ff486debd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:01:14.993568 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0e23d5541646cb89418f0148187fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:01:14.994211 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:01:14.994487 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:01:14.994755 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:01:15.005806 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:01:15.007298 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:01:15.018922 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1455/2919] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:01:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 17:01:15.290720 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:01:15.292323 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:01:15.304273 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc209-bcc6-4bd1-94a6-2b19421e833d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:01:15.309794 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22207ac88e304d2bb4d51c7880d43bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6b08d818d54c3e97808ca092a07d94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:01:15.310753 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:01:15.310953 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:01:15.311274 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] PATH_INFO: `/v3/projects/ef3b5f20e0d940108929dde87a65a85a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:01:15.313044 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3b5f20e0d940108929dde87a65a85a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:01:15.314503 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:01:15.364662 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3b5f20e0d940108929dde87a65a85a', 'request_id': 'req-9801fc86-d721-4951-92a8-26251b6fe3de'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:15.369718 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3b5f20e0d940108929dde87a65a85a', 'request_id': 'req-9801fc86-d721-4951-92a8-26251b6fe3de'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:15.375799 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3b5f20e0d940108929dde87a65a85a', 'request_id': 'req-9801fc86-d721-4951-92a8-26251b6fe3de'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:15.388339 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] The token cache is being invalidate because project ef3b5f20e0d940108929dde87a65a85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 17:01:15.388650 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:15.389251 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9801fc86-d721-4951-92a8-26251b6fe3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 17:01:15.390775 dv-cinder-820027-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1465/2920] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Dec 15 17:01:15 2021] DELETE /identity/v3/projects/ef3b5f20e0d940108929dde87a65a85a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 17:04:40.122397 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 17:04:40.124042 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:04:40.256682 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e178bf-07d6-4932-bd0e-ed389f29d47e service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 17:04:40.325474 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33525026fd94484faca1657116086daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400084fc2d6d496ab8e7710a0fa73c3f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 17:04:40.326132 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 17:04:40.326407 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 17:04:40.326680 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 17:04:40.328722 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 17:04:40.340275 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 17:04:40.341889 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067132fe-9002-4e15-a4dd-36f22a15a17a service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 17:04:40.351870 dv-cinder-820027-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1456/2921] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Dec 15 17:04:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)